I would have to say the Shadow Beasts as Link. It was okay to fight them as a wolf, but as Link, it was really tough and annoying. Especially in that room with the black fog.
EDIT: Oops. Ocarina of Time? I thought this was in World of Zelda!
Only thing I can think of right now are the Shell...