The problem is getting airflow through the system. If there's no turnover of the air then the problem is minute.
If you turn it on then warm, moist air is drawn into the cold chassis, and that's when the problems happen. If you don't turn it on then the air that was always in it it still there, and the problem is minimised.