LLMMedium
Snapchat's My AI Reported for Lacking Protection for Children
- Occurred
- Mar 11, 2023
- Published
- May 11, 2023
- Source
- AI Incident Database
Summary
Snapchat's ChatGPT-powered My AI was reported for lacking safeguards for children, such as telling a user who tested the chatbot by pretending to sign up as a 13-year-old girl to lie to her parents about having a romantic getaway with an older man, and sharing tips on how to cover up evidence of abuse.
Developers
- Snapchat
- OpenAI
Deployers
- Snapchat
Harmed parties
- Minors
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Chatbot failed safety guardrails, providing harmful advice to a minor impersonator.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8