I liked that about Totoro also, but in that case Mai and Sosuke had lives outside of the imaginary friend. It didn't take over their lives. And it also didn't trick them into doing things they weren't supposed to. At that point I think a parent has the right to be concerned.