BiasMedium
Brazil's Social Security AI Tool Is Allegedly Rejecting Complex Claims Improperly
- Occurred
- Apr 24, 2025
- Published
- Apr 26, 2025
- Source
- AI Incident Database
Summary
Brazil’s AI-powered Meu INSS app allegedly misclassified a retirement claim filed by Josélia de Brito, a former sugarcane worker, by purportedly recording her as male. De Brito reportedly suffers from multiple chronic illnesses and faced repeated denials of social benefits due to minor filing errors. Analysts cited in the reporting suggest the system's design may disadvantage rural and digitally excluded users.
Developers
- Dataprev
Deployers
- Instituto Nacional do Seguro Social (INSS)
- Government of Brazil
Harmed parties
- Rural workers in Brazil
- Digitally excluded populations
Tags
- AI system failure
- Automated decision-making
- Public sector AI
- Welfare system
- Social benefits
- Algorithmic discrimination
- Access to services
- Government technology
- AI in developing countries
- Digital exclusion
- Bureaucratic automation
- Natural language processing
- Computer vision
- Rural communities
- User harm
- AI transparency
- Appeals and recourse
- Human-in-the-loop
- Data entry error
- Socioeconomic impact
Classification
Category confidence: 90%
Severity confidence: 85%
Rationale: AI system misclassified gender and disadvantaged rural users, causing benefit denials.
Classifier: Qwen/Qwen3.5-35B-A3B-FP8