I've sprayed myself in the face with herpes juice when I fumbled with the collection tube. I've dipped my hair in amniotic fluid when baby came unexpectedly. And I've itched my face inadvertently with a gloved (but free of body fluid) hand.
As a rule, any time you are wearing gloves they should be clean. Any patient contact is a cue to change your gloves. If your gloves are soiled they come off immediately. And hopefully you were already taught this- never ever walk around gloved for no reason. Ever. It's gross because then no one knows if you are typing with goopy gloves or not. It also makes your hands all sweaty and yucky, increasing your surface bacterial load.
If you touched a patient's intact skin and then scratched your face, the risk of infection is no different than shaking a stranger's hand, barring special circumstances of course. I do not wear gloves unless there is potential for body fluids. I never wear them for routine patient care unless it is indicated by the patient's medical situation. Sanitize before and after, wash your hands regularly, and remember that just because they are patients does not mean they have cooties
Even if they did have cooties, they are rarely transmitted through casual contact.
And again- glove only when indicated, and take them off as soon as you no longer need their protection. Never hang out wearing gloves. ALWAYS practice universal precautions, always always. It is easy to get complacent with this.
But always consult a provider if you have any reason at all to be concerned about exposure to infectious agents.