I wouldn't take it personally because every speciality is seen as the bottom of the barrel by someone. If they're not putting down psych, they're putting down LTC...or L&D...or school nursing...or administrative RNs...and so on.
We are doing a lot for psych patients. We may not be inserting tubes, assisting in surgeries, delivering babies, monitoring heart rhythms, or trying to bring people back from the brink of death (ok, we are actually doing that last one a lot, especially with the suicidal patients). But we are taking care of some pretty significant patient needs because a patient is not just a body, but a mind as well. And not only are we taking care of that mind, we find ourselves taking care of that body as well because patients don't check their medical issues at the door when they are admitted
Also, if YOU are happy with your job, then that's all that matters. Who cares what anyone else thinks?