Holmes did imagine Mycroft saying "they" must win, because "we" are wrong.

Five Orange Pips contains the Ku Klux Klan reference. That explains the costumes.