I believe the Forest Temple definitely has its scary moments, however the fact that it is your first full fledged adult dungeon plays a huge part in that. The overall environment has a gloomy atmosphere with the introduction of the four Poes, the creepy Wallmasters, and the chilling music...