At the time there was a lot of members of the Tea Party that were just staunch conservatives who supported lower taxes, small government, and decreased spending.
But like your classic Nazi Bar scenario, they let too many racists hang out and the movement became a haven for white supremacy.