No it isn't crazy at all. Don't listen to someone else who tells you it is crazy. It is what YOU want to do. What kind of work can you get into with your MS? There are also loan repayment programs...
While waiting for a lottery I'd continue education into a BA/BS instead of jumping into a LVN. I am not a pro nor have I done this, it just makes the most logical