Yes. And in some mail clients / newsreaders, they would stack. E.g. in a reply to a reply to a reply of a message, each line of the original message would be offset with >>>.
It worked okay, but once stuff started wrapping at unintended points, it would get ugly to read.