Don't bother about what those co-workers are saying . . . you won't have to work with them any longer at your new job. Even though working in a float position has been stressful, it is a wonderful background for your new job. You have been exposed to many different patient populations & dealt with more physicians than you would have by working in just one department.
But - from your comments, I think you may have some misconceptions about the responsibilities of a first-line clinical manager, especially in a community hospital. You will learn about the paperwork/administrative tasks, but don't ever let these become more important than ensuring quality care. You will still be involved in providing care periodically. Whenever your staff needs an extra pair of hands, or you can't get coverage for a call-in, it will be your responsibility to 'assign yourself' to fill in. This is absolutely fundamental - you can't be an effective manager if you just stand by and do nothing while your staff are struggling. Been there, done that - going in to work to cover a night or weekend shift even though I was a 'manager'. I always made sure to work my share of holidays also. Even if I was not working, I came in to acknowledge (say "Hi" and "Thanks") to those that were working on a holiday.
Make sure you are 'present' for your night shift. This may mean coming in very early or staying late so you can spend some time with them. Otherwise, they feel completely ignored and resentful.
Don't try to make any changes for at least 6 months unless you need to correct a problem - that's how long it will take to understand how things really work in your new department. Get to know everyone - schedule meetings with them individually. Remember their birthdays, anniversaries, and names of their children. Always prioritize payroll & scheduling... because these are important to your staff.