I never thought the song was about infidelity, I thought it was about settling.  Like, someone knocked up a girl, and they married, and while he (or she) wants to be with someone else, they're obligated to stay and make it work and "love the one their with."  
I guess I'm more apt to defend it as such, as it sounds…

Peter Criss actually left the band a year after his mandatory album came out, so i don't think he exactly counts as "scurrying back"

Bryan Adam's One Night Love Affair?