BiasHigh
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
- Occurred
- Jul 26, 2007
- Published
- Mar 9, 2022
- Source
- AI Incident Database
Summary
In Spain, the algorithm that assesses recidivism risk in gender violence, VioGén, has allegedly critically underestimated the level of risk in a series of cases that ended in homicide of women and children since its first deployment.
Developers
- Spanish Secretary of State for Security
- Spanish Ministry of Interior
- Government of Spain
Deployers
- Spanish Ministry of Interior
- Government of Spain
Harmed parties
- Women
- Victims of gender violence in Spain
- Victims of gender violence
- Victims of domestic abuse
- Minors
- General public of Spain
- General public
- Women and girls
Classification
Category confidence: 85%
Severity confidence: 90%
Rationale: Algorithm misclassification led to homicides, indicating severe discriminatory harm and life-threatening consequences.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8