I thought that in the books, he wasn't thinking about her romantically? That, until she gets older, he feels like a protective friend/brother, and then things develop romantically once she's older? So, not quite as creepy, but the brother -> romance thing is creepy.