If your father or grandfather approached your mother or grandmother like this man did, then they were clearly the aggressor who took advantage. There are appropriate times and places to initiate anything with another person. This was not the proper method.