People seem to get confused between the events 10,000 years before BotW and those 100 years before BotW (both of which are referred to as calamities, due to the appearance of Calamity Ganon).
It was the events 10,000 years before BotW that led to the formation of the Yiga Clan... the fear of...