I think he was caught and injured by the Gerudo, then tried to swim back home, possibly to get reinforcements, or just medical aid, and he was attacked by some of the aquatic monsters until he was near death, that's when Link found him. Doesn't explain, however, why he'd be fine for the rest of...