BiasMedium
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated
- Occurred
- Jan 20, 2023
- Published
- Apr 3, 2023
- Source
- AI Incident Database
Summary
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
Developers
- Turnitin
Deployers
- Turnitin
Harmed parties
- Students
- Lucy Goetz
- High school students
- Educational communities
Classification
Category confidence: 85%
Severity confidence: 80%
Rationale: Tool falsely flagged student essays, reinforcing teacher bias due to lack of source comparison.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8