Are outpatient settings off limits without experience?

I've heard of new grads going straight to ER, OR, the units, even dialysis.

Is it impossible to get a job in something like outpatient oncology or outpatient surgery without prior in-hospital experience in those areas?

Early in my career, I had med/surg experience as an LPN. Now, am returning to nursing ( after an absence) as RN and don't want to go the med/surg route. I had enough of running around the floors and still have a neuroma on foot from my running the hall days ( I think that's where it came from).
I'm not young either.
It just seems to me like the happiest nurses are those who specialize. I just want to be happy with my work and of course would like great hours ( but that may be a fantasy I know). I did not feel a tremendous satisfaction in being pulled (sometimes literally) in a hundred directions. Although I can multi task (what mom can't) I don't know if I could do it for 12 hours continuosly.
This is so dang frustrating to find myself at this age and still not knowing what I want to do). Boy sometimes reading these threads I could cringe at what RN's are experiencing on the floors, much like my PN days but with so much more responsibility and no auxiliary help. I'm old enough to remember transport orderlies but even they didn't have a long career. I have tried a few other occupations but none pay the bills very well.
It would be nice to follow some specialities around for a day or two to help me discern. I am both attracted to and terrified of ER nursing.

Too young for the pasture