I don't think it was bestiality either. And JKR has admitted she mostly used the goat thing as a clue: when Harry first meets him in OotP he notes the bar smells strongly of goats, and a few books previously (I think?) Dumbledore mentioned his brother was arrested for doing something connected with goats or somesuch.