When you're a hat, everyone has power compared to you.
Link's power primarily comes from his courage, and his great sword skills as well as the various items he collects. He also has to be decently intelligent to solve the puzzles of various dungeons, and be able to use all those items he gets...