Skip to content
DeepfakeMedium

Microsoft Copilot Designer Reportedly Generated Inappropriate AI Images

Occurred
Mar 6, 2024
Published
Mar 6, 2024
Source
AI Incident Database

Summary

A Microsoft engineer reported that Copilot Designer, an AI image generator, creates content depicting sex, violence, bias, and more. Despite raising concerns and suggesting improvements, the tool remains public, prompting a letter to the FTC.

Developers

  • Microsoft

Deployers

  • Microsoft

Harmed parties

  • General public
  • Minors

Classification

Category confidence: 85%
Severity confidence: 90%

Rationale: AI image generator producing inappropriate content like sex and violence fits deepfake/synthetic media category with medium severity due to public availability and FTC letter.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source