You're a per diem. Everywhere I have worked that meant you had the right to say "I am available these days but not these days." Once the schedule is out, they shouldn't be adding you in without asking you, either.
I think you're in the clear to go do whatever the heck you want.

You're not leaving anyone short handed, you're not calling out sick... They might not have scheduled you because a) the FT and PT staff have to be assigned to the right # of holidays for it to be fair and b) they are expecting the hospital census to drop since very few people have elective procedures this time of year.
I would suggest that you thank the scheduler for such a wonderful chance to head home- let a couple key people know that you're taking the opportunity to head home for a few days but you're available to pick up extra shifts on short notice before and after your trip, then go have fun!
Nursing News