If it's an inside joke and you say it publicly, then how will it be received by those who aren't in on the joke. Do we care? Given the relative disposability of men, the phrase can easily be taken a different way. (men are trash=men are disposable) If we don't care, is that lack of concern in itself hateful?