In reality they did because people migrate; by choice or otherwise. They seem to be implying that this place is (possibly deliberately) cut off from the outside world. Thus, no migration. You can’t develop a diverse population if there’s no way for other people to move into it.