BiasMedium
Pennsylvania County's Family Screening Tool Allegedly Exhibited Discriminatory Effects
- Occurred
- Apr 10, 2017
- Published
- Feb 22, 2023
- Source
- AI Incident Database
Summary
Data analysis by the American Civil Liberty Union (ACLU) on Allegheny County's decision-support Family Screening Tool to predict child abuse or neglect risk found the tool resulting in higher screen-in rates for Black families and higher risk scores for households with disabled residents.
Developers
- Rhema Vaithianathan
- Emily Putnam-Hornstein
- Centre for Social Data Analytics
Deployers
- Allegheny County
Harmed parties
- People with disabilities
- Hackneys family
- Black families in Allegheny
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: ACLU analysis found discriminatory outcomes against Black families and disabled residents in a child welfare screening tool.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8