Startups are a signaling game. A large part of the reason why growth is important is because you're building a story for future investors to believe in, that you're trying hard to become the Next Big Thing. A lapse in focusing on growth signals that you might be satisfied with a smaller outcome, making it harder to attract VC money ever again, unless one has a plausible story otherwise.