BiasMedium
Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make
- Occurred
- Sep 20, 2021
- Published
- Sep 22, 2021
- Source
- AI Incident Database
Summary
Amazon's automated performance evaluation system involving AI-powered cameras incorrectly punished delivery drivers for non-existent mistakes, impacting their chances for bonuses and rewards.
Developers
- Netradyne
Deployers
- Amazon
Harmed parties
- Amazon workers
- Amazon delivery drivers
Classification
Category confidence: 85%
Severity confidence: 90%
Rationale: AI system errors caused unfair penalties for drivers, representing a discrimination or disparate impact issue.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8