Please help. Case for board discipline?

Hello all. I wanted to get your opinions on the legality of my issue. Here is the situation (sorry this is kinda long):

I am a psych nurse. Several years ago, I was working on an inpatient unit; I had a pt with whom I had a really good rapport and he was my pt on the unit for several months. It was obvious from the get-go that we had a strong connection, that he was interested in me romantically, but I kept everything professional and did NOT engage in any inappropriate behavior and declined to accept his phone # when he was being discharged. I informed him that it was not allowed nor ethical for me to accept his # and he went on his merry way. To be fully honest, I did have feelings for the man, he's a wonderful, brilliant, witty guy who just happens to have bipolar disorder. Other than that, he's high functioning and completely normal accept for the few times he's gotten sick with his illness. Periodically months later, he would call the nursing station to talk to me to tell me how he was doing---which is a common occurrance from former patients due to the fact we spent such long time with each of them on the unit.

Fast forward a year later and I happened to run into him at a public event. I was, of course, happy to see him and we went and had coffee later to catch up. I impulsviely gave him my phone number and things went from there. Yes, I knew at the time that this was an ethical grey zone, but I felt the way I felt and decided to throw caution to the wind and see where things went. I immediately got a job at a different hospital as it was obvious that the old hospital could have something to say about the situation. I read through the Nurse Practice Act and through multiple forums on this site to see what consequences could be had before things went too far, and came up with no situations similar to my own or any particular laws/rules that stated it could result in a disciplinary action. I was only able to find other states nurse practice acts stating that there was a year to 2 yr waiting period before engaging in a relationship with a former patient. My states nurse practice act does not even address the issue. I understand that having relations with a patient WHILE they are under your care is forbidden and completely unethical and I agree with that sentiment.

Now, said patient and I are very happily married. I understand that this is frowned upon, but we fell in love and decided to go with our hearts.

Now, an old friend from the old hospital where I met said patient, informed me that the hospital found out about the relationship is planning to approach the board of nursing about this. Of course, I am now worried that this could result in me losing my license. However, given all of the research that I was able to find out before I jumped into this, I'm not sure they have much of a case. The fact remain:

1. Nothing inappropriate went on while he was under my care.

2. I no longer work for the hospital where I met him.

3. We are married.

4. There is no case for anyone to say that I "exploited a vulnerable patient" or anything of that nature as this was completely consensual and our relationship began while he was stable and of sound frame of mind.

So, my question to you all, is, have you ever heard of a situation like this before, what were the results, and do you think that the old hospital where I worked would have a case? Please respond with advice if there are any legal ramifications. I understand that many of you will feel that I acted unethically, but I would prefer to not be attacked about this. I believe that I did nothing wrong. Thank you for reading my long post.