There are presently more Protestants than Catholics in Northern Ireland and more identify as British than as Irish in the sense of being affiliated with Ireland the country. So, basically you are talking about something that would not be settled by a vote, but by a bloody civil war, whether UK invades or not.