For all you know those people eating brunch donated time and money to racial equality groups and might just want a meal in peace. Assuming they are some kind of counter-revolutionaries is about as appropriate as a white person wandering into a black church and accosting people after being mugged.