It is far from arbitrary, it is extremely rare that a fetus delivered before 24 weeks survives, if they do they often have serious defects. And no, you don't have to give up your rights to keep others alive, but you can't exercise those rights in a way that would infringe on another person's rights.