So really if you think about it most games are based on The land of Hyrule in Ocarina of time because they are parallel worlds of it or they are alternate ending of it. So you have Ocarina of Time, then link falls into a portal into Majors mask, leaving Ocarina of Times Hyrule with out a Hero of...
Well... I think it more like Zelda logic were he plays his magical ocarina and all the great fairies transport him back to Hyrule threw a portal he rides Epona through. But that is why the creators leaves most things unexplained. Because that makes no sense.