Scoop
AI tool news · rumor vs. reality

The AI Wire ●

Rumors tracked. Announcements verified. Updated daily.

RELEASED

OpenAI releases a CSAM image classifier for vetted organisations — and ChatGPT now warns and pauses accounts that seek abusive material

OpenAI on November 16 released an image classifier built to detect child sexual abuse material (CSAM), including AI-generated images that hash databases have never seen. Developed with assistance from the National Center for Missing and Exploited Children (NCMEC), it is offered at no cost through the OpenAI API to vetted organisations, with Tech Coalition and ROOST helping share access.

In early partner testing, OpenAI says the classifier flagged 48% fewer images while finding the same number of abusive images, reducing reviewer workload — those are OpenAI's own test figures, not independently verified. A model card published the same day sets out thresholds and limits, including weaker precision on live ChatGPT traffic and no testing on video frames.

ChatGPT itself gains new interventions: a warning screen, removal of the flagged conversation and a 24-hour pause on access when someone tries to find material that sexualises children, rolling out gradually worldwide to personal accounts. OpenAI also published CSAM guidance for API developers and said it will supply child-safety law-enforcement units with AI investigation tools and training.

Sources

← Back to headlines