A person can tolerate multiple races and still be racist against persons of other races beyond those. Gandhi, for instance, was a firm believer in the necessity of South African Apartheid, and the British had very good relations with the indigenous Nepalese even while brutally occupying lowland India.