Not all people are fully self-motivated. There are plenty of very smart people who on their own will fuck around a lot, but in a well-managed office with (for example) a daily 5 minute standup, will get motivated and add a lot of value.

Then there are just people who will fuck around under any condition, and never add value. Bringing everyone into the office is the first step to sorting the former from the latter.