BiasMedium
Facebook, Instagram, and Twitter Failed to Proactively Remove Targeted Racist Remarks via Automated Systems
- Occurred
- Jul 11, 2021
- Published
- Jul 15, 2021
- Source
- AI Incident Database
Summary
Facebook's, Instagram's, and Twitter's automated content moderation failed to proactively remove racist remarks and posts directing at Black football players after finals loss, allegedly largely relying on user reports of harassment.
Developers
Deployers
Harmed parties
- Marcus Rashford
- Jadon Sancho
- Bukayo Saka
- Facebook users
- Instagram users
- X (Twitter) users
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: Automated moderation systems failed to remove racist content targeting Black athletes, indicating algorithmic bias and disparate impact.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8