At work yesterday, something happened and I’m honestly not sure how to go about dealing with it…

A 37-year-old guy, who works in a department separate from mine, is completely classless, crass, and all-around not someone I prefer to associate with.  Generally, I steer clear and keep him at arms’ length.  One of his characteristics includes the fact that he can’t speak a single sentence without saying “fuck”.  At any rate, here’s the situation….

I hear him, from my office, out around patrons speaking with cuss words thrown in the mix.  I stick my head out of my office and say “Hey, X, watch your language.”

him: “What was that?”

me: “Watch what you’re saying.  There are people around.”

*me, turning to go back into the office and to my desk, him now following behind me saying…*

him: “You’re not going to mind it when we’re in bed and I’m talking dirty to you. You’re going to love it.”

me: *sitting down in my chair* “Excuse me?”

him: *grabbing a fistful of my hair* “You’re going to love it… ooo I like this position (him still holding my hand, standing above me while I look at him bewildered)!”

me: I don’t know what the fuck I said.  I was baffled.  Completely baffled.

At this point, he must’ve realized he crossed the line, because he let go of his grip and walked out of the office.  I sat there for a minute, then he walked back in and I said “Don’t ever do that again… in this office, or out in the real world.” He just looked at me, said “what was wrong??”, then walked out.

Obviously, this is a prime case of sexual harassment, but I don’t know what to do!  I mean, there are a lot of other females who take sexual innuendos/jokes from him light-heartedly, so he’s probably never been reported for anything, but THIS was crossing the line.  I’m going to tell my immediate boss and see what she thinks.  At any rate, someone else, in the work office, will know what happened and be able to back it up if it comes up.  In my head, I’ve tried to rationalize it by saying that I’m young, nice, and like to joke around, so maybe I’ve smudged a professional line, but someone made a great point of saying that’s like saying girls who wear provocative clothing are asking to get raped.

Ugh… should I let this go and speak to him directly, or should I report him?