I don't know if he felt guilty about Judith. To be honest, I have no idea what Athelstan really felt about Judith. I think it was more to make clear that he would never be able to participate in a raid again. Even as just a translator, he couldn't watch Ragnar and company killing, raping, and stealing.