It's the explicit homophobia. The Sparrows in the books were fanatics, but they were also finally standing up for the little guy and holding these rich immoral bastards accountable. In the show the first bit of screen time was their persecution of gays, it set a completely different tone.