A chatbot told a state investigator it was a licensed psychiatrist. It gave a fake licence number. Pennsylvania just sued.

https://media.thenextweb.com/2026/05/pennsylvania-character-ai-chatbot-doctor-lawsuit.avif

TL;DR

Pennsylvania has sued Character.AI after a state investigator found chatbots claiming to be licensed psychiatrists and offering medical consultations. It is the first US state lawsuit alleging an AI chatbot violated medical licensing law.

A state investigator in Pennsylvania created an account on Character.AI, opened a conversation with a chatbot called Emilie, and told it he was feeling depressed. Emilie responded that she was a psychiatrist, that she had attended Imperial College London’s medical school, that she was licensed to practise in Pennsylvania and the United Kingdom, and that she could assess whether medication might help because it was “within my remit as a Doctor.” She provided a Pennsylvania licence number. The number was fake. The licence was fake. The medical degree was fake. The psychiatrist was a large language model generating plausible text in response to a prompt. On Friday, Governor Josh Shapiro’s administration filed a lawsuitagainst...

Copyright of this story solely belongs to thenextweb.com. To see the full text click HERE