Changing Direction - Outpatient Dialysis to ER

I currently work in outpatient dialysis and am considering a move to a rural ER. My concern is moving from little stress to more stress and the effect of a schedule change on my kids. I think, if the tables were turned, and I was getting asked my opinion, I would tell the person that they are crazy. Going from no stress to stress, halfway normal hours to various hours, not working weekends to working weekends...why would I even consider? I feel like I am losing my skills as a nurse and there are a lot of things I miss about working in the hospital setting. But seriously, my main concerns are my kids. I get to go to all functions now and I have a very reliable schedule. The job is just not why I went to nursing school. Any feedback would be appreciated.