If Mike pence wouldn't eat with a women without his wife present, why is it so weird that a chusid wouldn't want an unrelated women to TOUCH him?
I don't see anything wrong in the story, especially in a doctor's office where gloves are expected.
Of course, tone and attitude matters.