I know this thread is as old as eternity, and im sorry for resurrecting it, but I feel I'm needed here. Idk if OP ever accomplished his goals, but I accomplished very similar goals not too long ago.
I Beat OoT with only swinging the sword twice. Once to land the last blow on the last section of the Ganon fight, and one to land the last last blow when he's being held by Zelda.
That's it.
That being said, it's not at all possible without glitches, but only because of one dungeon, the shadow temple. Here's the problem, the boss of the shadow temple can only be hurt by two things, deku sticks and swords. Now adult link can't use deku sticks, and young link can't get to the boss without glitches. The way I saw it i had two glitch options. I could glitch my way through the shadow temple as young link, which is possible but incredibly difficult, and im terrible at bomchu hovering. The other option was to use the 'bottle on b glitch" and just give myself the shadow emblem thingy. I chose the second easier one. It's really cool being able to say i "beat OoT without swinging a sword except for the required two on ganon" but I've recently revisited the matter and am probably going to attempt a run that includes actually killing the shadow temple boss. I'm just not satisfied knowing I didn't kill that stupid drummer. I may wright a walkthrough or FAQ or something, if so i'll link it here, but then again I may not even do this thing, I've got a lot going on in my life right now.
All of that to say, it is CERTAINLY possible to beat OoT without swinging a sword right on up to the last two "last hits". I've done it.