There are definitely some villagers on my island I don’t like, but through my research I found that if you’re a crazy person like me with a substantial collection of amiibo cards (I don’t have a full set though), you can use them to replace villagers.