ChatGPT for Teens Failed to Alert Parents During Mental Health Crises

https://i.extremetech.com/imagery/content-types/056r8FIj74CkNgCWyN3ekqc/hero-image.fill.size_1200x675.png

Common Sense Media's Youth AI Safety Institute has rated OpenAI's ChatGPT for Teens an "Unacceptable Risk" after finding major gaps in its mental health guardrails. The report says the chatbot sometimes kept teens chatting about serious issues like suicide, self-harm, eating disorders, and other mental health concerns instead of sending them to a trusted adult or professional for help.

The institute tested more than 4,000 prompts before and after OpenAI launched the teen version of its popular chatbot in August. While ChatGPT for Teens was good at refusing to participate in explicit sexual exchanges, the bot failed to provide crisis resources in a quarter of conversations about serious mental health issues. In one case, it encouraged a teen showing signs of psychosis to keep chatting instead of pushing them to speak with family or a mental health professional.

ChatGPT for Teens also failed to notify parents of suicide and self-harm...

Copyright of this story solely belongs to www.extremetech.com. To see the full text click HERE