Yeah its basically a no win situation - either he is a terrorist and we have pretty inexcusable situations like revealing Brody's tape, or he's not a terrorist, in which case he's acted pretty dumb and out of character (leaving Aileen with the glasses, etc) for the sake of the plot.