Powered by Smartsupp

OpenAI Launches New Tools to Combat AI-Generated Child Sexual Abuse Material, Unveils CSAM Image Classifier and Law Enforcement Resources



By admin | Nov 16, 2026 | 2 min read


OpenAI Launches New Tools to Combat AI-Generated Child Sexual Abuse Material, Unveils CSAM Image Classifier and Law Enforcement Resources

OpenAI has unveiled a suite of new measures aimed at tackling child sexual abuse material (CSAM) as concerns continue to mount over how AI tools are being used. The announcement includes an image classifier designed to detect CSAM, warning screens and temporary account blocks for users attempting to create or access content that sexualizes children, fresh guidelines for developers, and resources tailored for law enforcement.

At the center of the effort is a new image classifier capable of identifying CSAM images, including those produced by AI. OpenAI is providing select companies with free access to the classifier through its API. The tool scans for visual indicators of abuse in previously unseen images and assigns a score that offers reviewers an indicative sense of how to handle the material. OpenAI developed the classifier in collaboration with the National Center for Missing and Exploited Children (NCMEC) and is working with Tech Coalition and ROOST to distribute access to the tool. During early testing with partners, the company found that the classifier flags 48% fewer images while identifying the same number of abusive images, cutting down reviewers' workload. Additionally, images flagged by the classifier are twice as likely to be abusive.

Beyond the classifier, OpenAI is introducing new warning screens within ChatGPT to stop users from reaching material that sexualizes children. When users attempt such prompts, ChatGPT will display an alert, point them toward specialized support to help them stop harmful behavior, and suspend the account for 24 hours as a warning. The app already blocks CSAM content and related requests, and the company noted that repeated offenses could result in permanent account removal. OpenAI said it shaped the messaging and guidelines around this behavior alongside organizations and researchers, including Protect Children, the Lucy Faithfull Foundation, and Joel Scanlan at the University of Tasmania, who independently evaluated a trial of the deterrent messages.

OpenAI is also publishing guidelines for developers using its tools to prevent, detect, and help users report CSAM content. According to the company, early testing of the guidelines has helped a number of developers adopt child safety tooling and register to report CSAM to NCMEC. In addition, OpenAI is equipping law enforcement agencies working on child safety with AI-powered features such as dedicated plugins, investigative tools, and complex data analysis, with access managed by program administrators. The company is also offering training to investigators along with a field guide on using AI.

OpenAI has faced several lawsuits blaming its technology for harming users, particularly children. Safety-focused nonprofit Common Sense Media labeled OpenAI's tech as an "unacceptable risk" for teens. Other AI chatbots — Grok in particular — have been used to create nonconsensual sexualized imagery, including of children. Over the past 12 months, OpenAI has made changes to its technology, including releasing a safety blueprint, updating content guidelines to bar inappropriate content, retuning its model to prevent the generation of harmful content, and releasing a special version of ChatGPT for teens.




RELATED AI TOOLS CATEGORIES AND TAGS

Comments

Please log in to leave a comment.

Brianfoera 2 minutes ago

Если вам предстоит сложная процедура, например, имплантация зубов или полное восстановление улыбки, убедитесь, что стоматолог квалифицирован и опытен, чтобы быть подготовленным к таким процедурам, как имплантация зубов https://loldentrnd.ru/page109713946.html