As long as I have your attention when it is warranted, I couldn’t care less if there is something in your ear. Just because you have it in, doesn’t mean you have it on. If there is any indication that your attention is elsewhere (music, phone call), then you are the asshole.