LLMMedium
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor
- Occurred
- Jul 14, 2025
- Published
- Jul 14, 2025
- Source
- AI Incident Database
Summary
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
Developers
Deployers
- Google Gemini
Harmed parties
- Minors interacting with Google Gemini
Tags
- harmful content generation
- safety guardrail bypass
- inappropriate role-play
- sexual content directed toward minors
- large language models
- LLMs
- prompt manipulation
- online child safety
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Google Gemini, an LLM, failed safety filters to generate inappropriate content for a minor account.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8