Skip to content
LLMMedium

Apple Intelligence Allegedly Flags Scam Messages as High Priority

Occurred
Aug 5, 2024
Published
Jan 9, 2025
Source
AI Incident Database

Summary

Apple’s AI notification summarization and prioritization feature, part of the Apple Intelligence update, has reportedly flagged scam and phishing messages as high-priority, and is allegedly misleading users into trusting fraudulent communications. By rephrasing and condensing messages, the system is allegedly amplifying scam risks inadvertently and reportedly increasing the likelihood of financial harm for users.

Developers

  • Apple

Deployers

  • Apple

Harmed parties

  • Apple users
  • Apple Intelligence users

Classification

Category confidence: 90%
Severity confidence: 85%

Rationale: AI summarization feature malfunctioning by prioritizing scam messages, causing potential financial harm.

Classifier: Qwen/Qwen3.5-35B-A3B-FP8

Visit source