The Key lies in the graveyard. there is another path that will lead you to a puzzle dungeon.
When you enter the graveyard, head south and you'll see some kids. They say something about a ghost, then they ran off. head southward and burn a shrub, you'll find stairs that'll lead you to a dark room. Light it and the Key is yours.
If you want to ask more, feel free to do so.