It was really dumb for tree man to not say "Look kid, if you do this memory/time shit with me you can semi-interact with the past, and doing so could be very bad for you and everybody you care about." but instead he acted like somebody saying "you shouldn't have too many cookies to a 5 year old".