They are all victims, to a point, except perhaps someone like Aunt Lydia, who is leading the charge for this regime and is absolutely brutal in every way to the Handmaids. She's one of those truly sociopathic people who derives pleasure from the suffering of others.