LLMMedium
Unrestricted AI Avatar Tool Accidentally Released by TikTok Permits Recitation of Hitler Quotes and Other Harmful Speech
- Occurred
- Jun 21, 2024
- Published
- Jun 24, 2024
- Source
- AI Incident Database
Summary
TikTok accidentally released an internal version of its AI digital avatar tool without safeguards, allowing users to generate videos where avatars could recite harmful content, including quotes from Hitler. The tool, meant for advertisers, was accessible to personal accounts and lacked the watermark indicating AI-generated content. TikTok has since removed the tool and acknowledged the problem.
Developers
- TikTok
Deployers
- TikTok
Harmed parties
- TikTok users
- General public
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI avatar tool failure allowed harmful speech generation, representing a language model safety breach.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8