I have never tried it, but it would be hard to pass the game without using a sword. Though if it was me, I would probably give up after the Forest Temple (not dungeon).
