You are never too old to go to nursing school
. So don't let that get in your way.
You do have to use math in nursing, but it's basic math. School will probably be more difficult than the actual job itself. I knew of a program that offered "math for nursing majors" or something like that. It was generalized and basic. You will probably have to take algebra. It's not bad. They will teach you everything that you need to know to pass. You won't have to take upper level math unless you decide to get your bachelors.
As far as debt, a community college is far less expensive than a university. It's probably a third of the cost. Once you graduate, it won't take you that long to pay off loans from CC. (I think college education is still a tax credit if you go full-time...not sure. If it is, a nice portion school is technically paid for when you get your tax return back).
If you really want to do nursing, then the length of time should be a factor.
If you are concerned with time, you can look into getting your LPN. However, some LPN programs are expensive. It is quicker though.
Look into the academic part of nursing. You say you are not good at math, but a&P, micro, patho, med/surgical, pharmacology are very extensive. Do you think you will be good at understanding medical theory, memorization, and writing lots of papers? It's endless in nursing school. You can always talk to an academic adviser. Good luck!