Yeah, overall the way they acted seemed rather odd. The Gems have interacted with humans as shown in the picture with the 4 of them with Garnet punching a shark. But I guess that could have been hundreds of years ago and their perception of people could have changed since the photo and the timeline for the episode.