You could do it if you memorized the location of everything, most likely.
I think I've opened invisible chests while not looking through the lens of truth, and you can definitely walk through invisible walls or defeat invisible enemies without it.
The hardest parts would most likely be the...