You don't need to build a stable culture for a galaxy wide colonisation.

We colonized the whole planet without that. Likewise a locust-like swarm of colonizing ships without any central control or common culture would also be a possibility.