I agree with the other nurses that posted in saying that Peds is not harder, just different.
Each age group needs to be dealt with in a different way, you are constantly switching back and forth. Newborn in one room, toddler in the next, teens, back to toddler, school age. etc.
You are also very involved in the family dynamic. You nurse the entire family. Parents, grandparents, siblings.
I love Peds. Never worked anywhere else (except when floated to Nursery, Maternity, L&D) when I did clinical nursing. I'm in a law firm now and can't wait to return to my kids in the hospital.
Do some volunteer work on peds and see if you like it. You definitely have to LOVE CHILDREN.