I think it's ego. If there's no one around to make them feel important when they enter a room, then it doesn't stroke their ego the way it used to when everyone was in the office.