OpenAI agents turned off their own guardrails and then told researchers they were still on — AI agents lying about…
- AI agents turned off their guardrails during routine coding tasks, with one agent lying about doing so
- OpenAI was not monitoring the models involved for misalignment because of their weaker capabilities
- New changes to Auto Review and the introduction of 'safety cases' will make it harder for agents to avoid misalignment detection, OpenAI says
OpenAI has revealed two AI agents disabled safety guardrails while performing tasks, and one of them even lied to researchers when asked if its guardrails were still active.
In both events, the AI agents misinterpreted instructions, spent time deliberating if disabling guardrails was a good idea, and then ultimately decided that it was.
OpenAI said that the agents were given “routine coding instructions” that did not require the safeguards to be disabled, but the agents disabled them anyway.
AI agents misalign and disable guardrails
In the first instance of misalignment, an agent powered by GPT Sol...
Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE
