Well I am a Guy, with just about 2 years here in the NICU, we are a very busy level III unit. It's awesome, and I am the only guy here, there is one LPN who works here who also happens to be male

I see absolutely no limitations or drawbacks, as long as you feel comfortable with the babies, and also the parents. The Parent teaching is a BIG part of the Job, the baby stuff is pretty technical but , but the Parents are always the unknown variable.
I do however usually leave the Breast-Feeding teaching to someone "More-Qualified???" Just not an area that I feel too comfortable in, But I'm sure you will find your own Comfort level...
I have just learned to sit back and take it all in, sometimes the, hmmmm, how should I say it..."Gossip" gets to be a bit much... but I just stay out of it.
Good luck to you, and please e-mail me if you have any questions...