To be brutally honest, I find it more condescending when people try to downplay the brutality and devastation colonialism enacted on the various native populations while trying to claim it was the victims of colonialism that were truly at fault.

Generally speaking, wiping out large amounts of any population whether intentional or not is probably going to have negative multigenerational effects.