Maybe if they showed a day pass by before Daryl returns it would have raised fewer eyebrows. They got back literally that night, which, sure, Abraham never could have known that. Maybe a throw away line where someone mentions, 'hey, that threat has been neutralized, what's the rush buddy' and he could have just blah…