Honestly, I agree with knowlee on almost the entire list. Here's my list of dungeons Link probably wouldn't get through :):
Shadow Temple: Like knowlee said, the Shadow Temple was downright scary. Blood smeared on the walls, a strange ferry, wallmasters, floormasters... no thanks. The feeling...