LLMHigh
Evolv AI Weapons Detection System Allegedly Misrepresents Accuracy, Leading to School Security Gaps
- Occurred
- Mar 22, 2022
- Published
- Nov 26, 2024
- Source
- AI Incident Database
Summary
Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.
Developers
- Evolv Technology
Deployers
- Charlotte Mecklenburg School District
Harmed parties
- teachers at Charlotte Mecklenburg Schools
- students at Charlotte Mecklenburg Schools
- Students
- security officers at Charlotte Mecklenburg Schools
- School administrators at Charlotte Mecklenburg Schools
- Parents of students at Charlotte Mecklenburg Schools
- Epistemic integrity
- Educational communities
Classification
Category confidence: 60%
Severity confidence: 80%
Rationale: AI weapons detection system failure led to physical injury, but classification is ambiguous as it is hardware-based AI rather than LLM.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8