Inappropriate Patient Behavior

I just experienced inappropriate behavior from one of my patient's last night and I wonder if I dealt with it in the right way.

I was taking a pt's BP and when I was taking the cuff off he tried to grab my thigh! I was kind of taken aback and I pushed his hand away, told him no, and that it was completely inappropriate. He was somewhat confused at the time and didn't know where he was. It was also one o'clock in the morning so I assume that the time didn't help his orientation either.

I'm a new RN and that is the first time that I have had to deal with that type of behavior. I was just curious as to how others out there have dealt with patients that act inappropriately or say inappropriate things. Thanks!