You know it actually would not be all that hard to do given the things established in the series now. There are already lots and LOTS of various dead, undead, and not quite dead things that have become staples of the series. As well as the slightly more recent addition of demons and their king in Hyrule. A game wrapped around the poes, poe collector, and the strange circumstances around the many restless spirits that d not at all want to rest or move on in Hyrule. Even in perfectly sunny, everything is fine Hyrule field in OoT had hordes of undead crawling out of the ground nonstop each and every night. The incredibly haunted shadow temple with all the spirits and nasty things willing to attack you or the Arbiter's grounds housing more restless dead show that Hyrule does have a pretty terrible past that it is always trying to hide. TP and OoT also established means of seeing invisible spirits to fight them.
I think a future game that takes a few of these already established elements and runs with them can make a pretty interesting game. Just imagine something like a poe, or greater spirit wanting the triforce for a chance at wishing for life again could be a new story in a different direction.