This sounds like the sort of vanity an inexperienced rider would exhibit. Screw their judgments. Every serious cyclist knows what interval training looks like, and they're not going to judge you as long as you're not annoying the shit out of them by leapfrogging them every 20 seconds.