Yeah I thought that explanation was a terrible move for Joe! The rest of the survivors should have said "oh okay, if you don't mind the rain then you can volunteer to sleep outside the new shelter!"
The whole white rock thing was almost like a mini game theory moment. Nobody wanted to be the one who prevented the tribe…