Skip to content
BiasHigh

Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders

Occurred
May 13, 2024
Published
Jun 15, 2024
Source
AI Incident Database

Summary

An Instagram ad campaign for children's merchandise was intended to reach adult women but was instead predominantly shown to adult men, including convicted sex offenders, due to Instagram's algorithmic targeting. This failure is reported to have led to direct solicitations for sex with a 5-year-old model in the ads.

Developers

  • Meta

Deployers

  • Meta
  • Instagram

Harmed parties

  • Instagram users
  • Instagram sellers
  • Minors

Classification

Category confidence: 85%
Severity confidence: 90%

Rationale: Algorithmic targeting failure exposed children to sex offenders, causing severe safety risks and potential legal consequences.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source