BiasMedium
UK Home Office's Sham Marriage Detection Algorithm Reportedly Flagged Certain Nationalities Disproportionately
- Occurred
- Mar 1, 2015
- Published
- Apr 19, 2021
- Source
- AI Incident Database
Summary
UK Home Office's opaque algorithm to detect sham marriages flagged some nationalities for investigation more than others, raising fears surrounding discrimination based on nationality and age.
Developers
- UK Home Office
Deployers
- UK Home Office
Harmed parties
- UK immigrant newlyweds
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: Algorithm flagged nationalities disproportionately, indicating discriminatory impact without evidence of severe physical harm or legal action.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8