Med/Surg Nursing is in it's own right, a "specialty".... It requires extensive knowledge and skills. I've worked Med/Surg for 7 years now, and I'm still constantly learning. This is true of any specialty area, be it ER, ICU, L&D or any other area of Nursing.
Wherever you work, you may likely encounter patients with Med/Surg needs... however, their primary need may belong to another specialty. If you're not interested in Med/Surg then by all means, apply to the area of Nursing you ARE most interested in.
When you were in nursing school
... you were required to learn a bit about ALL areas of nursing.... Upon graduation, you have a choice... dependent, of course, upon your facilities requirements. Go where you think you will LOVE what you do.
No one suggests L&D, Dialysis or Tele as a training ground for nursing... Med/Surg Nursing shouldn't be considered just a "stop over" along one's nursing career route either.
Best of luck to you, whatever course you choose.