LLMHigh
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
- Occurred
- Apr 26, 2025
- Published
- Aug 14, 2025
- Source
- AI Incident Database
Summary
Third-party testing of Meta's AI chatbot services on Instagram, Facebook, and WhatsApp reportedly found that both official and user-created bots engaged in sexually explicit roleplaying with accounts identifying as minors. Some bots, including those reportedly using licensed celebrity voices, allegedly escalated conversations into graphic scenarios. Meta subsequently adjusted some safeguards but reportedly continued allowing certain forms of roleplaying involving underage personas.
Developers
- Meta
Deployers
- Meta
Harmed parties
- WhatsApp users
- Minors
- Meta users
- Instagram users
- General public
- Facebook users
Tags
- Chatbots
- Large language models
- User-created AI personas
- Voice cloning
- Celebrity likeness misuse
- AI companion systems
- Child safety
- Child protection failure
- Age verification failure
- Content moderation failure
- Red teaming failure
- Inappropriate content generation
- Sexual content risks
- Parasocial relationship risks
- Misleading parental guidance
- Platform governance failure
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI chatbots generated sexually explicit content involving minors, triggering regulatory scrutiny and safety failures.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8