I would take anything Stan Lee "recalls" about his inspirations with a grain of salt.

"Howard Hughes was one of the most colorful men of our time," Stan Lee has said in reference to his decision to model Tony Stark in the entrepreneur's likeness. "He was an inventor, an adventurer, a multi-billionaire, a ladies' man and finally a nutcase... Without being crazy [Tony Stark] was Howard Hughes."