Well, remember he attempted to steal the entire Triforce, not just the ToP. I don't know if it would have gone to someone else if he hadn't stolen it, but I mean, he was the most powerful figure in Hyrule.
However, I think the biggest piece of evidence in favor of his being chosen is his...