BiasHigh
Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers
- Occurred
- Jul 10, 2024
- Published
- Jul 10, 2024
- Source
- AI Incident Database
Summary
Researchers have argued that the Department for Work and Pensions' Universal Credit system disproportionately impacts single mothers. Automated processes in the system, designed to determine eligibility and detect fraud, are reported to have introduced biases, leading to financial instability and hardship. The algorithms allegedly miscalculate earnings and delay childcare reimbursements, in turn exacerbating income volatility and debt among single mothers.
Developers
- Department for Work and Pensions
Deployers
- Department for Work and Pensions
Harmed parties
- Single mothers
- British single mothers
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: AI system allegedly causes financial harm and discrimination against single mothers through biased algorithmic decisions.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8