LLMMedium
ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report
- Occurred
- Sep 25, 2024
- Published
- Sep 24, 2024
- Source
- AI Incident Database
Summary
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
Developers
- OpenAI
Deployers
- Government of Victoria
- Employee of Department of Families Fairness and Housing
- Department of Families Fairness and Housing
Harmed parties
- Unnamed family of child
- Unnamed child
Tags
- response
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: ChatGPT generated inaccurate content in a legal context, causing privacy breach and potential harm to child protection case.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8