I hate the bosses where, if you fall, you have to climb up and start the entire thing over again. I HATE boss battles that do that.
That is probably the number one thing that irks me about A Link to the Past. It drives me crazy having to go through basically the entire dungeon again to get back to the boss. I always end up with only a handful of hearts when I reach the boss again. THAT is frustrating!