I think like, the Temple of Time was where it has always been. Then a while into the future the temple fell apart and became that area became the Sacred Grove, which can be accessed through the Lost Woods. But in OOT, pretty much anywhere in the game can be accessed through the Lost Woods...