In your case, because you know he’s deaf (and if you know he speaks ASL), it’s not rude, annoying or inappropriate to speak to him in language you he’s comfortable with. He wouldn’t be offended, even if your ASL is poor. He’d be happy you reached out to him and made the effort. Of course it’s always polite to ask…