I supposed....
Story-wise, Fierce Deity is very powerful... so Link isn't allowed to abuse that power, he can only use it when he needs it most to protect people (aka, in the boss battles)
Gameplay-wise, as Random Person said, he's freaking huge, and actually gets stuck inside some buildings...