BiasHigh
Australian Automated Debt Assessment System Issued False Notices to Thousands
- Occurred
- Jul 1, 2015
- Published
- Feb 20, 2023
- Source
- AI Incident Database
Summary
Australian Department of Human Services (DHS)’s automated debt assessment system issued false or incorrect debt notices to hundreds of thousands of people, resulting in years-long lawsuits and damages to welfare recipients.
Developers
- Centrelink
Deployers
- Australian Department of Human Services
Harmed parties
- Australian welfare recipients
Classification
Category confidence: 85%
Severity confidence: 90%
Rationale: Automated system caused widespread harm to vulnerable populations through incorrect debt assessments.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8