Not legally, it isn't. Simply not saying the word "yes" does not make sexual contact illegal; most of the world would be in prison if that were the case. I'm not sure I've ever actually uttered that word in the 25-ish years I've been getting busy with the fellas. Is that a thing that people do?