Skip to content
BiasHigh

Instagram's Algorithm Reportedly Recommended Sexual Content to Teenagers' Accounts

Occurred
Jun 20, 2024
Published
Jun 20, 2024
Source
AI Incident Database

Summary

Tests by The Wall Street Journal and a researcher reportedly revealed that Instagram's AI-driven Reels algorithm recommends sexually suggestive content to accounts listed as 13 years old. Despite Meta's commitment to restrict such content for minors, explicit videos were served within minutes of account creation, according to the findings.

Developers

  • Instagram
  • Meta

Deployers

  • Instagram
  • Meta

Harmed parties

  • Minors
  • Instagram users
  • General public

Classification

Category confidence: 85%
Severity confidence: 90%

Rationale: Algorithmic failure exposing minors to harmful content violates safety policies and regulatory standards.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source