I can relate to a certain extent. I hated clinicals in nursing school and my first nursing job in a hospital really made me miserable and drove me to drink. I wish I was kidding. I hung in there about 7 months, networked and was able to move on to an outpatient setting where life got much, much better. Don't get me wrong, it was still stressful and I had to work hard on my self confidence and self care. But I was much more suited to an outpatient setting. I eventually got a job as a public health nurse and that is what I do today and what I will continue doing for the foreseeable future. I can say I've been successful in my work, but I still occasionally have days where I fantasize about suddenly quitting and going to work in a grocery store. Nursing is a stressful profession and I am a person prone to anxiety. It probably wasn't my best choice for a career. But I found my niche and can function well and, for the most part, I go home at night peacefully and not dreading the next day.
You will probably have to go through a job or two that will be difficult but you could find a place in nursing that suits you. However, you have to decide how much you are willing to bear and whether you think it will be worth it.