Bingo.
Logically, the only thing I can think of to explain why the Master Sword and Temple of Time suddenly moved from Castle Town to the Lost Woods is that at one point between OoT and TP, the Hylians up and moved camp further north and the Lost Woods grew larger, eventually covering the...