I'm indifferent I guess.
Well because she is "talentless" and hasn't been able to awaken her sealing power he doesn't hold her in high esteem I guess. He obviously has a supriority complex. He's probably also mad that Zelda doesn't change her mind to make him the Chosen Hero instead of Link.