Yeah and that's why Ned is so opposed to killing children later on when it comes to Viserys and Daenerys. His perspective is totally informed by his thoughts of Jon.