They weren’t portrayed as rubes, the show actually did a rather clever thing in setting them up as men like Philip, only to have it be Elizabeth who could best understand their particular situation. The issue in that scene was that they couldn’t fill the emotional void Philip felt.