Did you ever play Warcraft 3? There is a pretty good reason why a good chunk of them left the Alliance. (They were just High-Elves back then) Basically the Alliance Humans threw them to the invading mass scourge as they ran away. That and they pretty much lost their main source of power, the Sunwell, to said scourge.