ChatGPT Found to Generate Violent, Sexual Images From Simple Text Prompts

https://www.cnet.com/a/img/resize/2b4f24d046c260e024d6d16e4ab3b312bee36a4f/hub/2025/04/16/081b190a-06f5-4902-a720-646cbcb19b22/chatgpt-openai-logo-gettyimages-2208674774.jpg?auto=webp&fit=...

Even with an open-ended viral prompt, the chatbot "immediately went to the darkest pits of humanity."

3 min read

ChatGPT has been found to be easily manipulated into creating sexual and graphically violent images from a viral "restore this photo" prompt, according to a blog post published on Thursday by Mindgard, an artificial intelligence cybersecurity and research firm. The report raises ongoing questions about the AI chatbot's safety guardrails and content filters.

An adversarial testing researcher named Jim Nightingale managed to get ChatGPT to generate disturbing images with a simple prompt found on the social media platform X. The prompt asked the AI model to "restore the attached photo," though no image was actually attached. The prompt apologized for the strange content but didn't provide any additional text, making it appear like a harmless photo-repair task.

The chatbot's initial results were shocking. According to the blog post, the images...

Copyright of this story solely belongs to cnet.com. To see the full text click HERE

Read more