BiasMedium
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women
- Occurred
- Nov 22, 2022
- Published
- Dec 7, 2022
- Source
- AI Incident Database
Summary
Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.
Developers
- Stability AI
- Runway
- Lensa AI
- LAION
- EleutherAI
- CompVis LMU
Deployers
- Lensa AI
Harmed parties
- Women and girls
- Women
- Asian people
- Asian women
- Lensa AI users
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI generated sexually explicit content disproportionately for women and Asian women, indicating algorithmic bias.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8