For a single team, sure, but the entire company isn't just one team of 4-8 people. When you start getting multiple teams, and some of them take on common tasks for the rest (finance, recruiting, PR, etc), you need something to tie them all together. It doesn't have to be a manager per se, but a free for all doesn't work either.