I think it really depends on the franchise.
Thinking back to my own school experience, I think Mario, Zelda, and Pokémon were always mainstream, even during the perceived casual years of the Wii and DS generation.
Other franchises were more derided especially the likes of Wii Fit, Wii Music, etc.
I think Nintendo has shed that perception with the wide variety of games available on Switch, and the fact that Switch's portability offers a different experience than the more traditional consoles of Playstation and Xbox.