Hacker News new | past | comments | ask | show | jobs | submit login
Bias in Criminal Risk Scores Is Mathematically Inevitable, Researchers Say (propublica.org)
4 points by jdp23 on Dec 30, 2016 | hide | past | favorite | 5 comments



The second graph in the WP tells the whole story, and it's not a complex one: A greater proportion of black offenders were in fact high risk, than white offenders. So naturally the "fair" and sort-of-accurate test flagged a greater percentage of the set of all black offenders as likely reoffenders, and this had the obvious consequence that there were BOTH (proportionately) more false positives amongst blacks AND (proportionately) more true positives when black offenders were tested, too, 'cause there were just plain more positives, proportionately, and would have been in any accurate test.

One could fiddle the test so that the percentage of false positives was the same for black offenders as white offenders, but only by reclassifying some black high-risk offenders as low; which would make the test less successful (less predictive) in sorting black offenders into high and low risk groups.

Somewhat similarly, if you tax rich people and poor people by an income tax you have to choose to be "fair" by charging them each the same number of dollars; or "fair" by charging them the same percentage of their income. You can't be "fair" by both measures at the same time because their incomes aren't the same. Not rocket science.


TLDR: There are two different intuitive definitions of predictive fairness. Given populations with different base crime rates, it is impossible to meet both fairness criteria.

If you can survive the WP payroll, the clearest article I've found on this is here:

https://www.washingtonpost.com/news/monkey-cage/wp/2016/10/1...

The full paper is here: https://arxiv.org/pdf/1610.07524v1.pdf


The clearest I've seen is this interactive visualisation: https://research.google.com/bigpicture/attacking-discriminat...


That is great to play with, although it seems to gloss over the fact that you can't have both kinds of fairness.


It defines 4 separate objectives (profit maximisation and 3 types of fairness), and shows that they each result in different thresholds. Just click any of the 4 red buttons.

It then goes on to advocate a particular kind of fairness.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: