It's not as annoying as much as it's vastly open. It's a kinda non-linear dungeon. Well, the first part that is. So, you gotta get 3 keys and you can get them in pretty much any order you want, however, they're scattered throughout the entire dungeon and it's a pretty huge dungeon with 3 floors...