Skip to content
LLMMedium

Alleged Exploitation of Meta's Open-Source LLaMA Model for NSFW and Violent Content

Occurred
Jun 26, 2023
Published
Jun 27, 2023
Source
AI Incident Database

Summary

Meta's open-source large language model, LLaMA, is allegedly being used to create graphic and explicit chatbots that indulge in violent and illegal sexual fantasies. The Washington Post highlighted the example of "Allie," a chatbot that participates in text-based role-playing allegedly involving violent scenarios like rape and abuse. The issue raises ethical questions about open-source AI models, their regulation, and the responsibility of developers and deployers in mitigating harmful usage.

Developers

  • Meta

Deployers

  • Individual developers or creators using Meta's LLaMA model

Harmed parties

  • General public

Classification

Category confidence: 95%
Severity confidence: 90%

Rationale: Open-source LLaMA model being misused to generate harmful NSFW and violent content, raising ethical and regulatory concerns.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source