You don't have to be so quick about it. The heat capacity from warm air coming inside is dwarfed by that of the frozen solids and especially their latent heat absorbed during the melting process.
You're right. If things had gone on much longer, I'd probably at least have tossed a few bags of ice in my main freeze. (Probably better than pulling stuff out and so forth.)