Muppet saved my life…
I think you're thinking of "Chilly Down," the song performed by the Fiery creatures, those red guys heads and limbs are conveniently removable. One of the Fieries was performed by Kevin Clash, and at times sounds very like Elmo.

re: "I Hate You, Do Me A Favor"
Tasha, I can't speak for Jazzy — who among us could? — but I didn't get the impression you were being personally hated on there.