Ah that makes sense. But unless he fathered a child with his hapless Frey pawn of a wife* the Frey claim to Riverrun is much more tenuous.
* He does get Roslyn Frey pregnant in the books; all three are slated for hostage-residence at Casterly Rock after the Riverrun showdown.