Why judges should NEVER START from algorithms...

(Paywall-free popularization like this is what I do for a living. To support me, see the end of this post)

and even less END with them.

Why judges should NEVER START from algorithms... /img/on-compas-algorithm.jpg

It so appears (*) that, in 2016, US judges, probation and parole officers were already “increasingly using algorithms to assess a criminal defendant’s likelihood of becoming a recidivist - a term used to describe criminals who re-offend."

And it also seems that things were not, so to speak, going equally well for everybody.

An analysis of one of the most used software tools of this kind, called COMPAS (which stands for Correctional Offender Management Profiling for Alternative Sanctions), found that “black defendants were far more likely than white defendants to be incorrectly judged to be at a higher risk of recidivism, while white defendants were more likely than black defendants to be incorrectly flagged as low risk”.

More in detail, a comparison of “the recidivism risk categories predicted by the COMPAS tool to the actual recidivism rates of defendants in the two years after they were scored [found] that the score correctly predicted an offender’s recidivism 61 percent of the time, but was only correct in its predictions of violent recidivism 20 percent of the time”.

What do the developers say?

[One of the developers of COMPAS] testified that he didn’t design his software to be used in sentencing. “I wanted to stay away from the courts,” he said, explaining that his focus was on reducing crime rather than punishment. “But as time went on I started realizing that so many decisions are made, you know, in the courts. So I gradually softened on whether this could be used in the courts or not.”

Still, the developer testified, “I don’t like the idea myself of COMPAS being the sole evidence that a decision would be based upon.”

All this sounds like just another consequence of prisons being a business, doesn’t it?

(*) the technical details, that is how the study was performed, on which data etc… are all here

Who writes this, why, and how to help

I am Marco Fioretti, tech writer and aspiring polymath doing human-digital research and popularization.
I do it because YOUR civil rights and the quality of YOUR life depend every year more on how software is used AROUND you.

To this end, I have already shared more than a million words on this blog, without any paywall or user tracking, and am sharing the next million through a newsletter, also without any paywall.

The more direct support I get, the more I can continue to inform for free parents, teachers, decision makers, and everybody else who should know more stuff like this. You can support me with paid subscriptions to my newsletter, donations via PayPal (mfioretti@nexaima.net) or LiberaPay, or in any of the other ways listed here.THANKS for your support!