Need advice about doing agency work...

So I was thinking that after my surgery, I might want to do some work with an agency. There is one near me that is hiring per diem shifts for an area hospital. Now in my contract, can I have my agency put a stipulation as to the area I want to work in, like "ICU/CCU only"? I just don't want to get sent to med/surg units that I've never worked before. This assignment would be at a small community hospital.