As a person who works in the field, I can promise you that this is a ridiculous thing to be upset about. Voicework is a marriage of vocal quality and an image that is unrelated to the actor playing the role. Your appearance, as the voice artist, makes no difference.