SWE-bench Scores Say Nothing About the Code Your Reviewers Inherit

Coding agents are graded on whether they can write code that passes tests, but nobody grades the review work that code creates once it lands in the queue.

The productivity case for AI-assisted coding has been made loudly ever since coding agents became capable of generating production-grade code at speed, and in the organizations that leaned into them hardest, the numbers genuinely hold up.

Developers who used to open two pull requests a week are now opening two to five a day, each carrying hundreds or even a thousand lines that an agent produced in the time an engineer would need to write a fraction of it.

There is a second number that gets far less attention, though, and the distance between it and the productivity figures is where most of the risk now sits. Even if AI-generated code carried no more bugs per line than human-written code, it...

Copyright of this story solely belongs to hackernoon.com. To see the full text click HERE