I had always just believed it was because we have more emotions invested in our partner, so we are bound to be more emotional where they are concerned. Heightened emotions are naturally going to lead to a more likeliness to become irritated.