Robert E. Lee and Poe were close in age. It's not outside the realm of alternative history that they might have been rivals at some point and after Lee accepted command of the Army of Northern Virginia, that Poe would declare for the Union and accept command of the Army of the Potomac just out of spite and enmity.