BiasMedium
Opaque Fraud Detection Algorithm by the UK’s Department of Work and Pensions Allegedly Discriminated against People with Disabilities
- Occurred
- Oct 15, 2019
- Published
- Feb 10, 2022
- Source
- AI Incident Database
Summary
People with disabilities were allegedly disproportionately targeted by a benefit fraud detection algorithm which the UK’s Department of Work and Pensions was urged to disclose.
Developers
- UiPath
Deployers
- UK Department of Work and Pensions
Harmed parties
- People with disabilities
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: Algorithm allegedly discriminated against disabled people, fitting bias category with medium severity due to allegations and lack of confirmed mass harm.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8