Context matters. It’s not “rapey” if you understand the culture and gender dynamics of the 1930s, when the song was written. There’s a good explanation here: http://persephonemagazine.com/2010/12/listening-while-feminist-in-defense-of-baby-its-cold-outside/