It is usually like that on the 3-D games.
On 2-D games, the temples are really mixed up and are really only there to get an item that leads to the next temple. If you are saying this about 3-D Zeldas, then you are basically right.
Good observation :)