BenchmarkJuly 27, 20261 min read
AI Agents Reach Cost Parity with Humans at $2,500 per 1% Speedup
A new metric developed by METR reveals the exact point at which AI agents become more expensive than humans, with a staggering $2,500 price tag for every 1% speedup. This breakthrough has significant implications for developers, businesses, and everyday users relying on AI models for various tasks.
METR's new metric, the "expenditure horizon," puts a dollar figure on how cost-effective AI agents are at solving problems. Early results on the NanoGPT speedrun are underwhelming, the metric has blind spots, and the newest generation of models could change the picture. The article METR introduces a new metric to calculate exactly when AI agents become more expensive than humans appeared first on The Decoder.