AI failed to properly patch software flaws 74% of the time, 1Password's study warns

https://www.zdnet.com/a/img/resize/82be725abd39463c65382c5ad894a75bfaafd3f9/2025/02/11/376c0500-7882-4375-b9bf-a34985b9eace/ai-fakes-open-source-program-security-patches-and-feature-reques...

Follow ZDNET: Add us as a preferred source on Google.


ZDNET's key takeaways

  • A new study shows the effectiveness of AI-generated patches.
  • Only 26% of the patches generated were actually usable.
  • AI isn't ready to patch the planet, but it can be used in cyberdefense.

New research has revealed that artificial intelligence and large language models (LLMs) are not ready to take on the task of creating fixes and patching security vulnerabilities.

Also: AI is finding bugs faster than humans can fix them: How enterprise security teams must adapt

1Password's new security research team, Off-By-1-Labs, published a new study on Thursday that explored what happens when you give LLMs free rein to generate fixes for new, complex vulnerabilities.

AI discovers bugs at scale, but can it also patch them?

The Off-By-1-Labs started with a hypothesis: frontier AI models would be able to produce "reasonably high patch success rates" -- perhaps...

Copyright of this story solely belongs to zdnet.com. To see the full text click HERE

Read more

https://www.politico.com/dims4/default/resize/1200/quality/90/format/jpg?url=https%3A%2F%2Fstatic.politico.com%2Ff6%2F0a%2F4e472ed54f338f0590b872d39a4c%2Fgettyimages-2298703502.jpg

How a small, wealthy AI-safety network that organized in Signal chats grew into a coalition that beat the $100M super PAC Leading the Future in the midterms

Featured Podcasts Big Technology Podcast: AI Stockpocalypse, Anthropic Nears RSI?, Prediction Markets vs. Pollsters The Big Technology Podcast takes you behind the scenes in the tech world featuring interviews with plugged-in insiders and outside agitators. Subscribe to Big Technology Podcast. Machine Gods: The Purple Tsunami Against Data Centers The official