Actually it would be the swords power which seals you up for seven years. The pedestal contains the sword's power. And the bigger thing to point out is the master sword isn't making you travel in time, not really. To weild the master sword you must be ready, Link wasn't ready and was sealed away until he was, hence it's power isn't time travel at all.
Also as a random guess for no reason, Bongo Bongo