There was of course personell in the camps who wasn’t Totenkopf-SS in the first place. And, even in Nazi-Germany, especially as an (Waffen-)SS soldier or officer, you still had considerable options to refuse this service (e.g. to go to the Ostfront instead or even be used at the “Heimatfront” for harvest or training…