Okay, this is how I view it, and it's a pretty nice theory if I do say so myself.
I just rewatched the ending to OoT. Zelda specifically says: "You must lay the Master Sword to rest and close the Door of Time."
Link has the power to close the door of time. This would solve everything...