BiasMedium
AI Spam Filters Allegedly Block Legitimate Emails Based on Biased Keyword Detection
- Occurred
- Oct 22, 2020
- Published
- Oct 22, 2020
- Source
- AI Incident Database
Summary
AlgorithmWatch tested spam filtering algorithms across Gmail, Yahoo, Outlook, GMX, and LaPoste. Their findings reportedly showed that Microsoft Outlook’s spam filter flagged emails based on specific keywords that led to racial and content-based biases blocking legitimate communications. Emails mentioning Nigeria or containing certain financial and sexual health terms were found to be disproportionately marked as spam.
Developers
- Yahoo
- Microsoft
- LaPoste
- GMX
Deployers
- Yahoo
- Outlook
- LaPoste
- GMX
- Gmail
Harmed parties
- Yahoo! Mail users
- Microsoft Outlook users
- LaPoste users
- GMX users
- Gmail users
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AlgorithmWatch found spam filters disproportionately blocking emails based on racial and content biases.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8