It's a different kind of "stressful". I have worked in the hospital setting, the office setting, and now the school setting, and can promise you they all have their own unique stressors. When I first started, the biggest gray hair inducer was being the only medical person around. It's different when you can't bounce ideas off of or work side-by-side with another health care professional. Students, faculty, and staff look to you for all of the answers, even when it's completely out of the nursing specialty.
The schedule is amazing, and honestly is at the top of the list of things that keep me coming back for more!
If you decide to shadow, my suggestion would be to sign up for more than one day. Make it a week if you can. Each day brings something new and you absolutely never know what is coming your way next! After almost 10 years, I still have days that I'm not sure I know exactly what I'm doing