Your Model Isn't the Hack Target. the Plumbing Around it Is.
Working in security taught me to ask one question about everything: what can go wrong? Here's what's going wrong with AI infrastructure, and why almost none of it is about the model.
When ChatGPT went mainstream, everyone's threat model was the model. Jailbreaks. Prompt injection. Hallucinations. Coax the thing into saying something it shouldn't and call it a day.
That's not what keeps me up at night anymore.
I've spent the last decade in this work: building AI products and endpoint security at Microsoft, securing cloud infrastructure at Atlassian, and now running Offgrid Security, where my team breaks AI systems for a living with our platform, Kira. From where I sit, the most consequential attacks of the past year didn't touch the model at all. They went after the machinery aroundit: the gateways, the routing layers, the tool protocols, the credential stores. A whole new tier of the stack...
Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE