Actually, many temples are temple-y, the forest temple is a hall with two courtyards and a secret place for rituals (boss location), the fire temple seems nice enough to the gorons based on the goron mines, the water temple and lakebed temple can also follow that previous logic, the spirit temple is very temple-y, but the main worship room is very protected and the entrances are blocked, justified in that Twinrova could go up take the gauntlets and then the Gerudo proceed to the main worship room, it even has a secret chamber to boot, the shadow temple is not a temple at all, the TP's temple of time isn't either, the temples in ST are not actual places of worship, but just homes of the beacons, the temple of the ocean king has a main hall and the rest is dungeon, the fire/wind/courage temples are not very temple-t, but if you use your imagination... the other temples in PH are less temple-y, but keep in mind the pyramid one is more of a deathtrap (was that one even a temple?) and that those are not places of worship either, they are housing the pure metals
That's all the temples I can recall from the games I've played, a vast majorty of them try to at least have a main worship room, I have no idea abut the temples in the other games though