Ontario auditors find doctors' AI note takers routinely blow basic facts
AI + ML
60% of evaluated AI Scribe systems mixed up prescribed drugs in patient notes, auditors say
The AI systems approved for Ontario healthcare providers routinely missed critical details, inserted incorrect information, and hallucinated content that neither patients nor clinicians mentioned, according to a provincial audit of 20 approved vendors’ systems.
The findings come from the Office of the Auditor General of Ontario, Canada, and are included in a larger report about the state of AI usage by public services in the province. They specifically address the AI Scribe program, the Ontario Ministry of Health initiated for physicians, nurse practitioners, and other healthcare professionals across the broader health sector.
As part of the procurement process, officials conducted evaluations using simulated doctor-patient recordings. Medical professionals then reviewed the original recordings alongside the AI-generated notes to evaluate their accuracy.
What they found was, frankly, shocking for anyone concerned about the accuracy...
Copyright of this story solely belongs to theregister.com. To see the full text click HERE