A man good question! I'm surprised I've never really thought of this. I guess I always just saw myself as a visitor to Hyrule.
I'd shack up in Ocarina of Time's Forest Temple, but given that it's already occupied by ghosts and demons and giant freaking spiders that's probably not the best...