They aren't studying bias in data. They were studying bias in AI. The data used was 850,000 chest x-rays from 6 publically available datasets. They aren't studying whether this dataset differs from the general public or has some kind of racial bias; that's irrelevant to the study.
> it tells us it can train to spot things that human rads do not train to spot
You're kidding yourself if you think you could determine someone's race with 97%+ accuracy from a chest x-ray if only you trained at it. The study authors (who are themselves a mix of radiologists and computer scientists) claim that radiologists widely believe it to be nearly impossible to determine race from a chest x-ray. No one is ever going to try to train radiologists to distinguish race from chest x-rays, so you'll always be able to hold out hope that maybe humans could do it with enough training. But your hope is based on nothing; you don't have a shred of evidence that radiologists could ever do this.
> I've never seen an AI spot one at an earlier stage than the best human rads can.
According to the article, AIs aren't trained to do this, because we don't have datasets to train this. You need a dataset where the disease is correctly labeled despite the best radiologists not being able to see it in the x-ray. Trained with a good enough dataset, they'd be able to see things we miss.
They aren't studying bias in data. They were studying bias in AI. The data used was 850,000 chest x-rays from 6 publically available datasets. They aren't studying whether this dataset differs from the general public or has some kind of racial bias; that's irrelevant to the study.
> it tells us it can train to spot things that human rads do not train to spot
You're kidding yourself if you think you could determine someone's race with 97%+ accuracy from a chest x-ray if only you trained at it. The study authors (who are themselves a mix of radiologists and computer scientists) claim that radiologists widely believe it to be nearly impossible to determine race from a chest x-ray. No one is ever going to try to train radiologists to distinguish race from chest x-rays, so you'll always be able to hold out hope that maybe humans could do it with enough training. But your hope is based on nothing; you don't have a shred of evidence that radiologists could ever do this.
> I've never seen an AI spot one at an earlier stage than the best human rads can.
According to the article, AIs aren't trained to do this, because we don't have datasets to train this. You need a dataset where the disease is correctly labeled despite the best radiologists not being able to see it in the x-ray. Trained with a good enough dataset, they'd be able to see things we miss.