Underground Market for LLMs Powers Malware and Phishing Scams

Summary

A study by Indiana University researchers uncovered widespread misuse of large language models (LLMs) for cybercrime. Cybercriminals, according to that study, use LLMs like OpenAI's GPT-3.5 and GPT-4 to create malware, phishing scams, and scam websites. These models are available on underground markets, often bypassing safety checks through jailbreaking. Named malicious LLMs are BadGPT, XXXGPT, Evil-GPT, WormGPT, FraudGPT, BLACKHATGPT, EscapeGPT, DarkGPT, and WolfGPT.

Developers

• OpenAI

Deployers

• Cybercriminals
• BadGPT
• XXXGPT
• Evil-GPT
• WormGPT
• FraudGPT
• BLACKHATGPT
• EscapeGPT
• DarkGPT
• WolfGPT

Harmed parties

• internet users
• Organizations
• Individuals targeted by malware