He invited Leni Riefenstahl to Hollywood and showed her around the Disney studios, and was long rumoured to be an anti-semite (as well as being fervently anti-communist and testifying before HUAC). It's not the most outrageous suggestion. It wasn't especially uncommon for people to sympathise with the Nazis.