LLMLow
Tougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)
- Occurred
- Jul 14, 2016
- Published
- Nov 1, 2022
- Source
- AI Incident Database
Summary
The 2016 Winograd Schema Challenge highlighted how even the most successful AI systems entered into the Challenge were only successful 3% more often than random chance. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
Developers
- Researchers
Deployers
- Researchers
Harmed parties
- Researchers
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: The Winograd Schema Challenge evaluates language model reasoning capabilities, representing a research benchmark rather than a harmful incident.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8