Skip to content
LLMMedium

Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise

Occurred
Sep 9, 2024
Published
Sep 11, 2024
Source
AI Incident Database

Summary

Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.

Developers

  • Google

Deployers

  • Google
  • AI Overview

Harmed parties

  • Parents
  • Google users
  • Google

Classification

Category confidence: 95%
Severity confidence: 90%

Rationale: AI model generated harmful advice due to context misunderstanding, causing unsanitary recommendations.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source