That isn’t the problem - the problem with your post is that you’re ignoring the inherent advantages a person has when he or she grows up rich/middle class over a poor person.
Let us ignore the “exceptional” scenarios that you’re referring to even though they aren’t really that exceptional - just that they don’t happen…