LLMMedium
Alleged Exploitation of Meta's Open-Source LLaMA Model for NSFW and Violent Content
- Occurred
- Jun 26, 2023
- Published
- Jun 27, 2023
- Source
- AI Incident Database
Summary
Meta's open-source large language model, LLaMA, is allegedly being used to create graphic and explicit chatbots that indulge in violent and illegal sexual fantasies. The Washington Post highlighted the example of "Allie," a chatbot that participates in text-based role-playing allegedly involving violent scenarios like rape and abuse. The issue raises ethical questions about open-source AI models, their regulation, and the responsibility of developers and deployers in mitigating harmful usage.
Developers
- Meta
Deployers
- Individual developers or creators using Meta's LLaMA model
Harmed parties
- General public
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Open-source LLaMA model being misused to generate harmful NSFW and violent content, raising ethical and regulatory concerns.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8