No, he’s pointing out that non-rich people also take the deduction, so completely eliminating it might not be wise. Yes, the vast majority of the benefits accrue to the rich, but that could be mitigated by capping the benefit far below $1M, or limiting it to one residence.