Just a quick “I’m not in the talking mood, thanks” would suffice.