LLMMedium
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims
- Occurred
- Sep 18, 2024
- Published
- Sep 18, 2024
- Source
- AI Incident Database
Summary
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
Developers
- Pieces Technologies
Deployers
- Pieces Technologies
Harmed parties
- Public health
- Patients
- Healthcare institutions
- Epistemic integrity
- Clinicians
Tags
- response
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI system marketed with misleading performance claims regarding accuracy and hallucination rates in healthcare.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8