You don't have to do the "stealth" part for that. I left him behind and went ahead and destroyed all the skywatchers with the giant steel boxes they have for you on the cliffs, then I went back and brought Yunobo along so I didn't have to worry about him getting spotted.
On topic, I had slight...