It's like a different setting. I'm not really sure of the mechanics to explain it, but the outside of his temple, is very different from the inside. Like, our living space is much larger than what it looks like from the outside. There's a forest surrounding a manor. Something like that can't fit within a tower,y'know. So I guess in order for it to fit, it has to be a different location. Like another dimension.