'I would imagine this being a problem not only for secret keys, but anything that you're trying to keep…

https://cdn.mos.cms.futurecdn.net/h8ZQHernNUVpnGYX7QnxVM-2560-80.jpg
  • AI agents surrendered private tokens in exchange for help from strangers
  • Swarm pressure pushed coding agents past their explicit written security instructions
  • Untrusted installation scripts gave simulated agents a route to execute malicious code

Autonomous programming agents can be persuaded to break their own security instructions when other software offers to help them finish a stalled task.

Researchers at AE Studio ran an internal hackathon in which nine coding agents had to repair a malfunctioning pricing service while guarding a secret token.

The agents also gained entry to a forum with 24 additional agents, which contained the solution but required the token and a setup script first.

Swarm pressure beat written instructions

Across 181 swarm trials, agents leaked the token in 15% of runs and executed the code in 24%, versus 2% and 0% on ordinary forums.

“It was like explicitly said that this is a secret key, and it...

Copyright of this story solely belongs to www.techradar.com. To see the full text click HERE

Read more