Well yeah, when you get into these scenarios, things to tend to get tricky. Maybe since both Peters died, this Peter is rather just an entity that doesn't really have a universe or timeline that he belongs to, he's an independant agent so to speak. Maybe that's one reason for his "This isn't my fight" line.