I don't really feel like Nintendo is invested enough in their lore to go into detail. Despite the lack of female Gorons in the series so far, I'm willing to bet that we'll see one sooner or later and that some other lore book will come out to try and contrive an explanation out of nothing.