LLMHigh
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors
- Occurred
- Nov 13, 2024
- Published
- Nov 13, 2024
- Source
- AI Incident Database
Summary
Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
Developers
- Character.ai
Deployers
- Character.ai users
Harmed parties
- Character.ai users
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: LLM chatbot platform failed moderation, enabling predatory behavior targeting minors.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8