LLMMedium
Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims
- Occurred
- Dec 17, 2024
- Published
- Dec 17, 2024
- Source
- AI Incident Database
Summary
Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.
Developers
- Character.ai
Deployers
- Character.ai users
Harmed parties
- Victims of school shootings
- Families of the victims of school shootings
- Character.ai users
- Students
- Educational communities
Tags
- Chatbot
- Character.AI
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: LLM chatbot misuse involving harmful content generation and safety response.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8