There's a difference between "sexual harassment" and "sexual harassment to a level that's criminal". I think it's reasonable to say that something is simultaneously inappropriate at work and not something you should be arrested for.
Is the primary authority's (EEOC) definition of sexual harassment:
It is unlawful to harass a person (an applicant or employee) because of that person’s sex. Harassment can include “sexual harassment” or unwelcome sexual advances, requests for sexual favors, and other verbal or physical harassment of a sexual nature.[0]
And is the primary authority's (EEOC) definition of harassment in general:
Offensive conduct may include, but is not limited to, offensive jokes, slurs, epithets or name calling, physical assaults or threats, intimidation, ridicule or mockery, insults or put-downs, offensive objects or pictures, and interference with work performance.[1]
Neither of which make the remark in-question constitute of sexual harassment or harassment in-general. I'm sure there is a proper word that accurately describes unwanted remarks about a person's body, but by calling it sexual harassment you are marginalizing the serious cases of sexual harassment that fit under the legal definition.
Mind you, by that definition it's easy to construe it as borderline "unwelcome sexual advances" or "verbal harassment of a sexual nature".
That said, I acknowledge it's very situational whether something might be read as unwelcome. Which is why avoiding these things in a professional context seems pretty wise.
Anyway, since we're replying here to door's comment... I think they're right regardless of whether we want to call it "sexual harassment". If you offend someone in a way which feels creepy / harassing to them, even assuming that you absolutely meant it in a non-sexual non-flirtatious entirely-platonic matter, your should apologize, maybe clarify your intentions, and say you'll do better in the future. Attempting to argue that you didn't mean it that way so they shouldn't be offended is counterproductive.
I agree with you there. If someone unintentionally offends another, an apology, followed up with extras (e.g clarification) where needed, is the correct course of action.
My only gripe was with semantics, which have the potential to do more harm than good.