Yeah, I don't get your point either. Of course some of the military defected in the Civil War, mostly the military that hailed from the South. Which, surprise, left the sides relatively evenly matched in personnel. Off the top of my head, both Robert E. Lee and Stonewall Jackson were among those defectors.