Mandatory Reporting Prior To Licensure

I have had my nursing license since august 2003. An incidnet occurred prior to me obtaining my license. My childrens father was convicted of being a sex offender minor under age 13 in April 2001. I was still in nursing school then. The victim was female and of course he said he was innocent. Before I allowed him to spend time with his children (both boys) I asked his parole officer if he was allowed and she said it was allowed. The oldest was 6 years at the time. Dad "found " out that an 12year old girl I trusted to babysit had assult our son we reported it but nothing could be proven, then dad started accussing the older of assulting the youngest age 1.5 at the time, again no real proof of this. About 2 months after the "talk" I found out that dad had told the oldest he would hurt him if it ever happened again and he also allowed the oldest to view an adult movie for 1 hour while he went up stairs to work on the computer. This is so his son would not be "gay". I have since left the state I was in to live with mom and save money. I want to go back to that state because it is a great place to raise children, but I worry. I left the state while dad was re-incarcerated for parole violation. He has been out since 4/2005. His parole officer has completed two polygraphs that show he might have assulted his own boys. I was to shocked for words and all the wrong things came out which makes it sound as if I knew and did nothing. Now if I move back they want to interview my boys, but my oldest said nothing has ever happened except for the video thing. And dad is no longer allowed to have contact with me or the boys til his parole is done 11/2006. Dad has told me not to come back because they will take my boys and arrest me and take my license. So my real question is should I take a chance and go back or just stay away all together?
sorry so long I needed to make sure all bases were covered. All these incidnets occurred prior to me becoming a nurse. After the video thing he was never alone with the boys again, when I worked they were at a home daycare facility.

Any suggestions are appreciated.

Thank you for your reply and no nothing has occurred with me. But I am not sure what to do and I have left him because I could not deal with the situation and because I worried that things were going to go in that direction. My boys are way more important than my licnese but I love being a nurse and I worked really hard to get to this point. I did it all by myself with out family but with GOD as my guide.