I think he did say that but he is selfish man. Overturning Loving would remove protections for him and his wife. His wife is being investigated for her involvement in the January 6th attack and he cannot be compelled to testify against her as long as they are married.