No he doesn't. He left because he was worried Coulson would make good on the mind-wipe threat and he knows Kara will have a melt-down without him, just like she did when Whitehall died. Coulson's whole phone conversation was him taunting him about not being able to help Kara.