Skip to content
LLMMedium

Alleged Misuse of PicSo AI for Generating Inappropriate Content Emphasizing "Girls"

Occurred
Oct 24, 2023
Published
Oct 24, 2023
Source
AI Incident Database

Summary

PicSo AI, which appears to be getting advertised by Meta over Instagram, is allegedly being used for generating inappropriate content with an emphasis on "girls." This raises concerns about the misuse of generative AI technologies for creating offensive and potentially sexually explicit material that could be used for nefarious and criminal purposes.

Developers

  • PicSo AI

Deployers

  • Meta
  • Instagram

Harmed parties

  • Potentially exploited groups
  • General public
  • Consumers

Tags

  • generative AI
  • deepfake porn
  • content moderation
  • gender bias

Classification

Category confidence: 90%
Severity confidence: 80%

Rationale: Generative AI misuse for inappropriate content generation without confirmed mass harm or legal action.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source