Skip to content
LLMMedium

YouTuber Built, Made Publicly Available, and Released Model Trained on Toxic 4chan Posts as Prank

Occurred
Jun 3, 2022
Published
Jun 7, 2022
Source
AI Incident Database

Summary

A YouTuber built GPT-4chan, a model based on OpenAI’s GPT-J and trained on posts containing racism, misogyny, and antisemitism collected from 4chan’s “politically incorrect” board, which he made publicly available, and deployed as multiple bots posting thousands of messages on the same 4chan board as a prank.

Developers

  • Yannic Kilcher

Deployers

  • Yannic Kilcher

Harmed parties

  • internet social platform users

Classification

Category confidence: 95%
Severity confidence: 90%

Rationale: Model trained on toxic data and deployed as bots, causing controversy without physical harm or legal action.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source