BiasHigh
Department for Work and Pensions (DWP) Algorithm Wrongly Flags 200,000 for Housing Benefit Fraud
- Occurred
- Jun 23, 2024
- Published
- Jun 24, 2024
- Source
- AI Incident Database
Summary
A Department for Work and Pensions (DWP) algorithm wrongly flagged over 200,000 UK housing benefit claims as high risk, resulting in unnecessary investigations. Two-thirds of these flagged claims were legitimate, causing wasted public funds and stress for claimants. Despite initial success in a pilot, the algorithm's real-world performance fell short. This incident highlights the risks of overreliance on automated systems in welfare administration.
Developers
- Department for Work and Pensions
Deployers
- Department for Work and Pensions
Harmed parties
- UK general public
- UK housing benefit claimants
Classification
Category confidence: 85%
Severity confidence: 90%
Rationale: Algorithm wrongly flagged 200,000 legitimate claims, causing harm and financial waste.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8