First, just to make sure you have the key, you get it here, in a place called the Southern Shrine:
Then, go out of the maze you came through to get here. From that maze, after exiting up one screen, go LEFT, UP, and LEFT again, passing through all of the rocks and such. You'll see some...