I was one of those nurses who stated I was not ever going back to the bedside when I became a CM and I allowed every certification to expire. However, when I wanted a promotion, case management became a dead-end career/job. I was not able to move up due to lack of positions, the few openings being very competitive, and lack of leadership experience on my part at the time. So, I went back to the bedside.
I received an entry-level (ANM) position in Telemetry (front-line managers where I worked can be pulled into assignments and can often cover breaks due to being short staffed), so I cannot write that you are crazy returning to bedside nursing for the reasons you wrote. On the other hand, I kept my CM position per diem for many years because I wanted the option to jump-ship if the reasons I left bedside nursing the first time came up again.
I finally gave up my CM position recently. Although the reasons I left the bedside have come up again in spades because I am an assistant nurse manager, I have grown to prefer the negatives/cons of bedside nursing to those of case management. In addition to what you have written and I have experienced, case managers can work long hours and put in a lot of work just like any other nurse, but not be viewed as hard workers by other departments, not be viewed as nurses (???), and not have opportunities to take off because no one can cover them. Not to mention some case management departments are not even run by nurses or are run by nurses with very little years of work experience in any area of nursing! But I digress.... to reiterate my above point, the pros to bedside nursing are overwhelmingly heavy on the side of having nursing career choices and seeing nursing career progression compared with opportunities of a nurse case manager. Good luck!