BiasMedium
Genderify’s AI to Predict a Person’s Gender Revealed by Free API Users to Exhibit Bias
- Occurred
- Jul 28, 2020
- Published
- Jul 30, 2020
- Source
- AI Incident Database
Summary
A company's AI predicting a person's gender based on their name, email address, or username was reported by its users to show biased and inaccurate results.
Developers
- Genderify
Deployers
- Genderify
Harmed parties
- Genderify customers
- Minority groups
Classification
Category confidence: 95%
Severity confidence: 90%
Rationale: AI system exhibits biased gender predictions based on names and emails, causing inaccurate results.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8