The Ents were unified against Saruman. They didn’t have some Ents in the swing glades thinking “ I’m uncomfortable with his pro Uruk-hai stance but he said he would bring back mulch jobs that had been shipped to Mordor, so maybe I will sit this fight out”