Some people cared from the perspective of the workplace. If Pence can’t trust himself alone with a woman, he might be less likely to hire women, to include them in vital discussions, or to promote them, because he wouldn’t want the opportunity to even arise.