I've heard it both ways, but the "damaged" male is usually used when a man is violently pyscho or is an extereme "moma's boy". I think you're reading too much into it in this case. It's not "too sad to be fuckable" it's "I don't want to take advantage of this person who has issues and seems overly vulnerable."