There were technically tons of grounds for annulment in medieval times, of which failure to consummate was only one. Admittedly the likelihood of these being accepted by the Pope greatly increased depending on how powerful you were, and how powerful the family of your spouse were (should they oppose the annulment).