Ha! I completely forgot about this comment.

In Rose's videotape, we also see the temple entrance: still no house, looks just the same as it does in this episode. So clearly the house was built for Steven, immediately before or sometime after he was born.