The latter seems more likely. Who wants a fish tank with nothing but standard yellow goldfish in it? And if all the humans were the same color, how could the status- and hierarchy-obsessesed Gems sort them in any meaningful way (or even tell them apart)?