Many years ago, I drove 2 hours each way to work in the subspecialty I really wanted. I got a modified Baylor, weekends-only position and rented a room locally so I only made the round trip once, and didn't drive back and forth multiple times in a week. I started out getting a cheap motel room, but, as I got to know people at the hospital, one of the nurses knew someone who was interested in making some extra money by renting out a room (but didn't want to just advertise to the general public, since she was an older woman living alone). The situation not only worked out well, but we ended up becoming close friends.
In my situation, it was totally do-able and totally worth it.