LLMMedium
Alleged Instagram Algorithm Malfunction Floods Users' Reels Feeds with Violent and Graphic Content
- Occurred
- Feb 28, 2025
- Published
- Feb 28, 2025
- Source
- AI Incident Database
Summary
An alleged Instagram algorithm malfunction caused users' Reels feeds to be overwhelmed with violent and distressing content. Many reported seeing deaths, extreme brutality, and other graphic material in rapid succession, often without prior engagement with similar content. The sudden exposure caused psychological distress for many users, with minors and vulnerable individuals particularly affected by the graphic content. Meta confirmed an AI failure was responsible and apologized.
Developers
- Meta
Deployers
- Meta
Harmed parties
- Minors
- Meta users
- Instagram users
Tags
- Content moderation failure
- Algorithmic harm
- Recommendation system
- Traumatic content
- Psychological distress
- Harmful recommendations
- Unsafe content curation
- Vulnerable users
Classification
Category confidence: 85%
Severity confidence: 90%
Rationale: AI algorithm failure caused widespread exposure to graphic content, resulting in psychological distress.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8