While I agree that "culture fit" certainly is double-speak for a lot of toxic crap and discrimination, I think that corporate culture is something very important and worth keeping / building a good one.
Culture is also wether to be a perfectionist or to ship things now, even if they have bugs. To spend time sharing your knowledge with others or to document the code. To create a design or to quickly do what the customer wants. To generate comprehensive documentation, or to give personalised support. To tolerate brilliant aholes (hey, they are geniuses after all) or not.
All those things are different approaches to work, and being in places where the culture is different of your own can be a pain for both sides.
Culture is also wether to be a perfectionist or to ship things now, even if they have bugs. To spend time sharing your knowledge with others or to document the code. To create a design or to quickly do what the customer wants. To generate comprehensive documentation, or to give personalised support. To tolerate brilliant aholes (hey, they are geniuses after all) or not.
All those things are different approaches to work, and being in places where the culture is different of your own can be a pain for both sides.