I hate to tell you but one of the reasons why google ate the world was their hands-off management and peer-to-peer project management and feedback schemes, which are efficient and effective. I know experiences at large organizations can vary, but for years at that company I had managers who existed, yes, but never showed their faces and were there chiefly to make sure that everybody had desks and chairs and computers. This style scales extremely well. I also had managers who were just other ICs to whom I reported, because there had to be a path from Larry to everyone in the org chart, but who were otherwise peers. Not every large organization is choked with weekly/daily meetings and org charts full of useless functionaries.
I hate to tell you, but the only reason Google “ate the world” during the times you describe (which I’m skeptical of, but that’s a separate discussion) was that they figured out they could sell ads against their search results. Almost everything else seemed exactly like what you’re describing: a bunch of ICs with no managers building cool stuff that didn’t affect the bottom line, had bad usability, didn’t have a clear use case, overlapped the work of other teams, or all of the above.
The Google of today is different: multiple billion dollar business units, all well-staffed with managers.
