I second the others who have said that you should just tell him directly that you need to work now and that you’ll talk to him later. If he doesn’t respect that you can’t talk, you should sit down and have a serious conversation with him about boundaries when you are less busy.