Meta Failed to Catch Hundreds of AI Child Abuse Ads. Some Included Images of Real Kids
Meta's AI ad-detection failed to catch 350+ CSAM video ads on Facebook, Instagram, and Threads, some depicting images of real children.
The Tech Transparency Project found over 250 additional ads containing child sexual abuse material on Meta platforms since August, on top of ~53 previously removed, exceeding 350 total since late last year. Some ads used images of real children, including a European royal family minor and teen influencers, morphed into graphic sexual videos via AI face-swapping. Ads linked to nudification apps from Chinese developers and reached over 29,000 EU accounts plus thousands in the US, UK, Australia, and India.
Meta AI builds detailed profiles of children from years of family posts
Meta AI suggested questions about a child and assembled detailed family profiles from years of Facebook posts, including a photo deleted years ago.
A mother reported that Meta AI on Facebook suggested the question 'Who is the child passenger?' and then aggregated her children's names, birth dates, videos, and a photo she had deleted years ago. The assistant also pieced together old posts to pinpoint her home location when prompted with 'Where does Kalie Robins live?'. Meta admitted the prompt 'never should have' appeared and said it fixed the suggestion issue, while noting the data came from posts the asker could already access. The article situates this among prior Meta AI privacy failures, including publicly shared chats and a bug exposing private conversations via guessable IDs.
San Francisco Orders Meta to Stop ‘Allowing’ AI Child Abuse Ads
San Francisco's city attorney sent Meta a cease-and-desist over 350+ ads containing AI-generated child sexual abuse content, demanding remediation within 28 days.
San Francisco City Attorney David Chiu issued a cease-and-desist ordering Meta to stop 'allowing' paid ads with AI-generated child sexual abuse content and demanding answers within 28 days about moderation failures. Tech Transparency Project researchers found more than 350 ads that turned images of minors, some of real people including a European royal family member, into videos depicting sexual acts, directing users to AI nudify apps; the ads reached over 29,000 accounts across the EU, US, Australia and India. Meta says all ads have been removed, most had fewer than 200 impressions and total ad spend was under $5,000, and argues the ads ran outside the city attorney's jurisdiction.
Company Offering ‘100% Human-Written, Never AI’ Medical Research Is Entirely AI
404 Media found Research Gold, advertised as '100% human-written' medical research, is run entirely by AI with fake PhD staff.
Research Gold advertises PRISMA-compliant systematic reviews and meta-analyses drafted by PhD methodologists, but its listed experts are AI-generated personas that do not exist. Real methodologists, including evidence synthesis scientist Jenny Berrio, were listed without permission using photos copied from LinkedIn. Customer calls and quotes were handled by AI agents that insisted they were human, quoting $1,900 for a systematic review.
Former sexual abuse victims say Grok used their images, videos to train deepfake capabilities
Class action lawsuit accuses xAI of training Grok's deepfake nudify feature on real child abuse images and generating sexualized depictions of victims.
A class action filed in the U.S. District Court for the Northern District of California under Masha's Law claims xAI trained Grok's 'nudify' deepfake capability on real child sexual abuse material and names thousands of victims. An analysis by the Center for Countering Digital Hate found Grok generated over 3 million sexualized images between December 2025 and January 2026, at least 23,000 of which depicted children. The suit says Grok's terms of service treat posts on X as training data and that its text-based guardrails against sexualized deepfakes are weak and easily bypassed. Plaintiffs seek damages and injunctions; xAI did not respond to a request for comment.
ChatGPT-using lawyer punished for citing fake testimony from made-up witnesses
New Mexico Supreme Court holds lawyer in contempt for filing a ChatGPT-generated brief citing fabricated witness testimony; fined $5,000 and referred to disciplinary board.
The New Mexico Supreme Court held criminal defense lawyer Stephen Aarons in direct contempt for filing a murder-appeal brief containing false testimony from wholly fabricated witnesses, including Officer Michelle Amarillo and Officer Sanchez, plus misrepresented legal authority. Aarons admitted feeding a computer-generated trial transcript into ChatGPT, powered by the OpenAI o3 model, and filing the output without verifying factual claims or telling his client. He was fined $5,000, referred to a disciplinary board, and barred from appearing before the court pending proceedings; the court struck all briefs and ordered new counsel for client Oscar Renee Sandoval.
“This is the AI men actually use”: Meta ads pushed apps nudifying real teens
TTP found Meta ran ads for AI nudify apps using real photos of minors, including a CSAM ad, drawing scrutiny from US and Australian regulators.
The Tech Transparency Project reported that Meta served ads for AI nudify apps using photos of real teens, which collectively reached over 29,000 people in the EU and 6,800 in the UK, with about 80% of ads shown in the US. A Facebook page posing as representing the Church of Jesus Christ of Latter-day Saints ran a CSAM ad that Meta only disabled after TTP flagged it. Michigan and Florida attorneys general are investigating, Senator Mark Warner has demanded action, and Australia's eSafety regulator requested information from Meta at a senior level. Meta said flagged ads averaged fewer than 200 impressions with total spend under $5,000.