JBMmom

I wouldn't be able to tell you whether you're making a mistake, I can only share my experience. I enjoyed my med-surg experience but in the end I chose to move to ICU because I wanted to know more about everything going on with my patients. My med-surg busy was more physically busy in that I covered a lot of ground with 6-8 patients on nights, spread throughout the 30 bed unit. For the most part, the patients were very stable and I could usually count on at least 1-2 to sleep a good portion of the night. When things got crazy was when there were more labor intensive interventions like CBI, hanging blood, post -surgical pain management. And when I had a patient experiencing an acute change in condition it could throw everything else way off schedule. 
In ICU, for the most part I'm in my patient's rooms multiple times an hour. The chaotic part is managing 8-12 drips on 1-2 patients (and sometimes 3, but hopefully one is less busy), and when things start going bad you're stuck in there trying to fix stuff. There's a lot more to know about each patient and their condition and current interventions. Vent settings, drip titrations, etc. (I don't work in a high acuity unit with ballon pumps or CVVH) You're much more involved in every aspect of patient care than on a med-surg floor.
You won't know until you try it, good luck with whatever you choose. 

I'm good with nurse. Been called way worse, at least they're putting the effort to recognize an attribute rather than just "hey" or "hey you".