Researchers Decrypt Hidden Chain-of-Thought From OpenAI, Anthropic and Google APIs

https://hackernoon.imgix.net/images/n5ld9fKE5xhTwn7KxPGA8cNuAi42-zm83bm3.png

Stealing Reasoning Traces from Proprietary LLM APIs

Authors: Alexander Panfilov, David Schmotz, Ilia Shumailov, Luca Beurer-Kellner, Joachim Schaeffer, Ameya Prabhu, Jonas Geiping, Maksym Andriushchenko


Abstract

Leading large language model providers now conceal their models’ step-by-step reasoning, or chain-of-thought, to protect intellectual property and limit information leakage. Rather than storing these traces server-side, providers return them to the client as blocks of encrypted text, which the client passes back with each subsequent request. Building on prior research, we identify an architectural vulnerability: these encrypted blocks are fully compatible and interchangeable across different sessions, users, and models within a provider’s ecosystem. We exploit this compatibility to develop a scalable decryption jailbreak. By injecting an encrypted reasoning trace from a given model into a weaker, and less safeguarded model from the same provider, we force it to decode and output the trace verbatim in plaintext, without ever jailbreaking the more capable model directly.

...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE

Read more

https://images.ctfassets.net/kftzwdyauwt9/2YS8yWiGpKflhlEnAkcLU/f51ead4391706f6c3198f0d61a0f147a/research-acceleration-the-jagged-frontier-social.png

OpenAI says agents now complete 46% of its researchers' 2-to-4-hour tasks on their own, vs. 23% in March, median researcher's agent use hit $2,400/day, and more

More: Digital Foundry on YouTube, Kotaku, Kotaku, IGN, The Guardian, IGN, Axios, The Guardian, MobileSyrup, Game Informer, Eurogamer.net, Streams Charts, Eurogamer.net, Digital Foundry, PCMag, Fortune, Windows Central, Wccftech, Video Games Chronicle, Kotaku, Eurogamer.net, GamesRadar, UnHerd, Washington Post, Mashable, Forbes, Ars Technica, Wired, PC Gamer, Comic Book, GamesBeat,