For those saying "Why isn't (x) here?", there is an "Other" option :P
I vote for Other: Eagle's Tower from Link's Awakening (original). Main reason? The game-breaking glitch with the wrecking ball. The boss being able to throw you out is also obnoxious.
On a similar note, the second worst for...