BiasMedium
Researchers find evidence of racial, gender, and socioeconomic bias in chest X-ray classifiers
- Occurred
- Oct 21, 2020
- Published
- Oct 21, 2020
- Source
- AI Incident Database
Summary
A study by the University of Toronto, the Vector Institute, and MIT showed the input databases that trained AI systems used to classify chest X-rays led the systems to show gender, socioeconomic, and racial biases.
Developers
- Qure.ai
- DarwinAI
- Aidoc
Deployers
- Mount Sinai Hospitals
Harmed parties
- Economically vulnerable patients
- Hispanic patients
- Women and girls
- Patients
- Medicaid beneficiaries
- Women
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Study identifies demographic bias in medical AI classifiers without reported immediate harm or regulatory action.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8