^I believe that's only the case in Eldin Volcano. The Mogma's have shattered the key to the Fire Temple, supposedly because they don't want you in there. When you find them though, they warn you to look out for the 'red guys' that went in there.
Or, maybe they saw them go in and destroyed the...