Well, it depends a lot on how it's executed. I definitely don't want a stealth mission like in WW's Forsaken Fortress again, for me that was the most annoying part of the whole game, even more so than collecting the Triforce Shards, mainly because you had no other combat items you could use and had to wait ages for the guards to pass by and they caught you at totally random distances and angles and you had to do the whole thing all over again, equaling instant death in other Zelda games where a game over also resets you to the entrance of a dungeon.
If they decide to include a swordless part, Link should at least be able to use other weapons and he should not be resetted to the beginning of that part instantly on enemy (eye) contact. Furthermore it shouldn't be a large part of the game, after all it's Zelda and not Metal Gear.