Honestly, he was pretty much as good a sport in this circumstance as someone can be. It doesn’t sound like he felt entitled to have sex with you. As you say he was confused by your sudden rejection and obviously bothered that your feelings for your ex were so strong (because he kept asking if you were really over it…