Yes I think you are right. I actually do enjoy playing Majoras mask, I just wish it wasn't timed. It's not bad for side quests, I just don't like it when I'm in a dungeon. I try to 100% them, so I feel rushed with the clock ticking down and I'm trying to figure out puzzles and find all of the...
1. Wind Waker (so fun and adventuresome!)
2. Twilight Princess (close 2nd)
3. Ocarina of Time (great story)
4. Skyward Sword (enjoyable but a little frustrating with mechanics at times)
5. Majora's Mask (do not like being timed)