For the record, when Patrick has sex with kevin in the office, he and Richie is sort of taking a break. I dont rememeber it well but yeah they technically didnt break up officially at that point. But later it is clearly Patrick wasn't exactly comfortable about what he did, especially when Richie came to him to have…

Patrick running away is not selfish. Kevin wants an open relationship and he clearly knows thats not their thing.