Skip to content
LLMHigh

Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs

Occurred
Sep 11, 2023
Published
Jul 31, 2024
Source
AI Incident Database

Summary

Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.

Developers

  • Meta

Deployers

  • Instagram
  • Facebook
  • Meta

Harmed parties

  • Instagram users
  • Facebook users
  • Elijah Ott

Classification

Category confidence: 85%
Severity confidence: 90%

Rationale: AI moderation failure led to death, involving content generation and filtering systems.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source