Skip to content
BiasHigh

Department for Work and Pensions (DWP) AI Systems Allegedly Discriminate Against Single Mothers

Occurred
Jul 10, 2024
Published
Jul 10, 2024
Source
AI Incident Database

Summary

Researchers have argued that the Department for Work and Pensions' Universal Credit system disproportionately impacts single mothers. Automated processes in the system, designed to determine eligibility and detect fraud, are reported to have introduced biases, leading to financial instability and hardship. The algorithms allegedly miscalculate earnings and delay childcare reimbursements, in turn exacerbating income volatility and debt among single mothers.

Developers

  • Department for Work and Pensions

Deployers

  • Department for Work and Pensions

Harmed parties

  • Single mothers
  • British single mothers

Classification

Category confidence: 95%
Severity confidence: 90%

Rationale: AI system allegedly causes financial harm and discrimination against single mothers through biased algorithmic decisions.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source