Skip to content
DeepfakeHigh

Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission

Occurred
Mar 5, 2025
Published
Mar 5, 2025
Source
AI Incident Database

Summary

Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.

Developers

  • Google

Deployers

  • Google

Harmed parties

  • General public
  • General public of Australia
  • Google Gemini users
  • Victims of deepfake terrorism content
  • Victims of deepfake child abuse
  • Victims of online radicalization

Tags

  • Google
  • Self-reporting
  • Australia
  • Deepfake
  • Terrorism
  • CSAM
  • eSafety Commission

Classification

Category confidence: 90%
Severity confidence: 85%

Rationale: AI-generated terrorism and child exploitation content reported to regulators constitutes severe harm requiring regulatory action.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source