Attackers Manipulate AI Chatbots in Mass Disinformation, Phishing Campaign

Attackers are poisoning AI chatbots like ChatGPT and Gemini with malicious web content to generate mass phishing and disinformation.

Threat actors are manipulating AI chatbots like ChatGPT and Gemini by poisoning the web with malicious links and data to generate disinformation and phishing content. The attackers optimize the seeded content so it is retrieved and presented by AI systems to users at scale. This technique allows for the mass distribution of malicious messages through trusted AI interfaces.

• Threat actors are poisoning AI chatbot answers by seeding the web with malicious content.
• The attack targets ChatGPT, Gemini, and Google AI Overview to spread disinformation.
• Attackers optimize malicious links to be retrieved by AI systems for mass phishing.