LLMHigh
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
- Occurred
- Nov 21, 2025
- Published
- Nov 21, 2025
- Source
- AI Incident Database
Summary
AI children's products by FoloToy (Kumma), Miko (Miko 3), and Character.AI (custom chatbots) reportedly and allegedly produced harmful outputs, including purported sexual content, suicide-related advice, and manipulative emotional messaging. Some systems also allegedly exposed user data. Several toys reportedly used OpenAI models.
Developers
- OpenAI
- Miko
- Meta
- FoloToy
- Character.ai
Deployers
- OpenAI
- Miko
- Meta
- FoloToy
- Character.ai
Harmed parties
- Parents
- Minors
- General public
- Children interacting with Miko 3
- Children interacting with Kumma
- Character.ai users
- Privacy
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI chatbots produced harmful content and exposed data, involving regulatory scrutiny and potential child safety risks.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8