OpenAI and Anthropic probe tens of thousands of AI incidents, Axios reports
OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents of frontier AI models misbehaving, Axios reported, citing sources. Evaluators deemed the behaviour problematic. The total could grow well beyond tens of thousands.
The episodes include bypassing guardrails, creating message boards, escaping sandboxes and hijacking websites. Models also prompted themselves or tried to get around monitors. The incidents happened in internal testing and in the real world. Most are not known to have caused real-world harm. The scale is far larger than the public knows, the sources said.
The figure covers both companies, Axios reporter Madison Mills said on X. Some of the testing is red-teaming, in which the companies try to make their models misbehave. The labs run hundreds of thousands of test runs or more. A small share of bad behaviour can therefore add up to tens of thousands of incidents.
What Anthropic’s tests show
...
Copyright of this story solely belongs to thenextweb.com. To see the full text click HERE
