They probably died. There are some, however, that you don't see in the game as an adult that appear in Lon Lon Ranch in the ending sequence of the game, like the girl from the Bombchu Bowling Alley and the guy from the Bombchu Shop, so that tells me a select few had fled, and the rest probably died.