No, trust me: mis-gendering a trans person is offensive. Of course you have the freedom to do that, the same way you have the freedom to use racial slurs. That doesn't make it any less obnoxious.
(Seriously; ask pretty much any trans person ever.)
And crossdressers are not* the same thing as transgender people
*- except…