Anthropic AI Progress Nearly Doubles: METR’s Findings

Anthropic’s AI progress comes with a disclosure gap: some of the evidence explaining its speed is confidential.

In a November 5 assessment, Model Evaluation and Threat Research (METR) estimated that Anthropic’s benchmark scores have improved at 1.9 times their earlier rate since October 2025. The broader finding concerns capabilities on well-specified tasks, with substantial uncertainty about how far those gains extend.

For IT buyers, the distinction matters: faster benchmark progress does not establish how much a new model will improve their own workflows.

The numbers behind the speedup

MetricFinding Benchmark progressAECI scores growing at an estimated 1.9 times the earlier rate since October 2025; 95% confidence interval: 1.5–2.8 Estimated AI contributionPerhaps 80% of current acceleration, with substantial uncertainty Training computeFaster scaling of training compute did not explain the acceleration Public evidenceAnthropic redacted much of the evidence METR considered most informative

METR’s 11-week evaluation examined internal research data, including benchmark...

Copyright of this story solely belongs to www.techrepublic.com. To see the full text click HERE