OpenAI Launches AI Tool to Detect Child Abuse Images

https://assets.techrepublic.com/uploads/2026/11/strengthening-online-child-safety-inline-warning.png?f=jpeg

AI-generated child sexual abuse material is creating new challenges for online safety teams, particularly when images have never been seen or flagged before.

OpenAI has introduced an image classifier designed to identify potential child sexual abuse material (CSAM), including AI-generated images. The company says early testing reduced the number of images requiring human review by 48% while identifying roughly the same amount of abusive material as its existing system.

The tool is being offered free through an API to vetted organizations, with support from the National Center for Missing & Exploited Children (NCMEC).

OpenAI is also introducing stronger ChatGPT interventions for users seeking material that sexualizes children, expanding its efforts beyond detection to prevention and enforcement.

Partner evaluations produced additional findings, although the organizations measured different outcomes and the results should not be treated as directly comparable.

The partner testing produced additional results:

  • fal:Human reviewers confirmed 72% of high-confidence...

Copyright of this story solely belongs to www.techrepublic.com. To see the full text click HERE

Read more