Most (all?) fridges have a low voltage shut off now - when they sense the battery is below a threshold you set, it turns itself off.
Given that, and as long as you don't want to run anything else while the engine is off (lights, water pump, charging big electronics), I think you'll be fine...