Rumors of him being gay have been pretty loud. This could easily be one of the reasons he cut his family off.