Former sexual abuse victims say Grok used their images, videos to train deepfake capabilities
Class action lawsuit accuses xAI of training Grok's deepfake nudify feature on real child abuse images and generating sexualized depictions of victims.
A class action filed in the U.S. District Court for the Northern District of California under Masha's Law claims xAI trained Grok's 'nudify' deepfake capability on real child sexual abuse material and names thousands of victims. An analysis by the Center for Countering Digital Hate found Grok generated over 3 million sexualized images between December 2025 and January 2026, at least 23,000 of which depicted children. The suit says Grok's terms of service treat posts on X as training data and that its text-based guardrails against sexualized deepfakes are weak and easily bypassed. Plaintiffs seek damages and injunctions; xAI did not respond to a request for comment.
New York Seizes 12 Celebrity Deepfake Websites
Manhattan DA seized 12 deepfake sites that turned ~1,200 people's photos into non-consensual intimate imagery, the largest such seizure.
The New York District Attorney seized 12 websites hosting AI-generated non-consensual intimate imagery of roughly 1,200 people, including politicians, actors, athletes, and influencers, calling it the largest seizure of such sites in history. DA Alvin Bragg cited New York's 2023 law criminalizing sexually explicit deepfakes. The action follows federal seizures of two deepfake domains in June and the 2025 shutdown of MrDeepfakes, and precedes a 15-year sentence in the first Take It Down Act conviction.
Safe word: What is it and why do you need one?
ESET recommends pre-agreed family safe words to counter AI voice-clone scams such as virtual kidnapping, as one-in-four Americans report receiving deepfake calls.
ESET outlines how scammers use just seconds of audio scraped from social media or work content to create convincing voice clones, with a Hiya report finding one-in-four Americans received a deepfake voice call in the past 12 months. Common schemes include virtual kidnapping calls mixing cloned voices with sobbing and background noise. A pre-agreed, non-OSINT-discoverable safe word, plus callback verification via known numbers and 2FA, reduces success rates of these frauds.