I doubt this, unless you’ve got evidence. Like older/less attractive women, unattractive men frequently report feeling invisible. Short men are outright ruthlessly mocked for their height. I’m not like a men’s rights activist or anything but I don’t think this is a gendered issue.