OpenAI offers free CSAM image classifier and ChatGPT account pauses
November 16: OpenAI detailed API access, NCMEC’s role, Lantern and Thorn’s Safer, plus developer and investigator resources beyond the earlier briefing figures.
OpenAI is giving vetted groups a free CSAM image classifier and adding ChatGPT warnings and 24-hour account pauses.
On November 16, OpenAI announced tools to detect and deter child sexual abuse material, including AI-generated images. A new image classifier, developed with NCMEC, scores unseen images for visual signs of abuse and is offered at no cost through an API to vetted organizations, with the Tech Coalition and ROOST helping share access. OpenAI says early tests flagged about 48% fewer images while finding roughly the same number of abusive ones, and that flagged images were about twice as likely to contain abuse. ChatGPT will warn users who attempt prompts that sexualize children, direct them to support, and pause the account for 24 hours, with permanent removal possible for repeats. OpenAI also published developer guidelines, said it reports CSAM to NCMEC, and described investigator support.
- Classifier is free via API for vetted organizations, with NCMEC involvement.
- OpenAI says tests cut flags about 48% while finding similar abusive images.
- Flagged images were about twice as likely to contain abuse, OpenAI says.
- First ChatGPT offense brings a warning and a 24-hour account pause.
- OpenAI says it joined Lantern and supports Thorn’s Safer.
- NCMEC CyberTipline logged 400,000 generative AI reports in 2025, up from 67,000 in 2024.
Timeline
dated events in the reporting · oldest first- Nov 16, 2026OpenAI announces CSAM classifier and ChatGPT pauses. · OpenAI News
What each outlet adds
beyond the shared facts- OpenAI NewsCalls it the first broadly available classifier with an AI-generated signal; cites Lantern and Thorn’s Safer.
- The VergeReports CyberTipline generative AI reports rose from 67,000 in 2024 to 400,000 in 2025.
- TechCrunchNotes developer guidelines, law-enforcement tools and training, and possible permanent removal.
- Vendors
- OpenAI
- Products
- ChatGPT
- Organizations
- NCMECTech CoalitionROOSTCommon Sense MediaThorn
- Countries
- United States
Coverage
oldest first · one row per article · UTCOpenAI releases CSAM classifier and ChatGPT warning blocks
Select companies get the classifier free through an API, and blocked ChatGPT prompts can trigger a 24-hour suspension.
OpenAI releases free CSAM image classifier for vetted organizations
Early internal tests estimated 48% fewer flags while finding about the same number of abusive images.
OpenAI launches classifier to detect AI-generated child abuse imagery
OpenAI says the tool flags 48 percent fewer images while doubling the share that contain abusive material, with free access for vetted groups.