The problem is that most people aren’t anti-abortion fanatics. Even people I know that wouldn’t personally consider having an abortion still think it should be freely accessible for others. This is going to keep happening because the people that actually want abortion outlawed are just a vocal minority.