Hum....
I think that it is either a temple or hyrule castle.
Temple
He could have just defeated the temple and is riding to another temple to complete it.
~Reasons~
He has the hero of time tunic on and he is smiling because he got rid of more evil that lied in hyrule...