I think that the two hardest points of the game are the very beginning, until you get the blue ring and white sword, and from level 5 and beyond, where the Wizzrobes and Darknuts come out in full force. By and large, it isn't easy, but is certainly doable.