So the real issue is what, exactly? Women's breasts are evil and must be hidden at all costs?
There are two differences between men's breasts and women's breasts: (1) composition ratio and (2) milk production. Neither of those inherently are sexual.