Also, why did they move to Death Mountain? Jabun, their original guardian diety, resides in Greatfish Isle. Comparing the maps of OoT and WW, it appears that Greatfish Isle is above the Gerudo Valley.
The most sense I can make of that is if the entire Zora race, along with Jabu-Jabu, migrated...