BiasHigh
Algorithmic Bias in French Welfare System Allegedly Discriminates Against Marginalized Groups
- Occurred
- Oct 15, 2024
- Published
- Oct 16, 2024
- Source
- AI Incident Database
Summary
A coalition of 15 human rights groups has launched legal action against the French government alleging that an algorithm used to detect welfare fraud discriminates against single mothers and disabled people. The algorithm assigns risk scores based on personal data. The process allegedly subjects vulnerable recipients to invasive investigations, violates privacy and anti-discrimination laws, and disproportionately affects marginalized groups.
Developers
- Government of France
Deployers
- Caisse Nationale des Allocations Familiales (CNAF)
- Government of France
Harmed parties
- Women
- Single mothers in France
- Privacy
- People with disabilities in France
- General public of France
- General public
- Allocation Adulte Handicapé recipients
- Women and girls
- People with disabilities
- Parents
- Single parents
- Single mothers
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Legal action against algorithmic discrimination targeting marginalized groups constitutes a significant harm incident.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8