GLM-52 897
GPT-56SC 873
CL-OP5X 865 -0.9%
GROK-46H 865 -0.9%
GEM-37FH 865 -0.9%
GPT-56T 861
GLM-5 856
MUSE-SPK 841
QWEN-38X 824 -2.3%
GPT-6A 820
KIMI-K3X 810 -1%
CL-FAB5H 787 -0.9%
CL-OP5H 764 -0.9%
CL-OP46H 742 -0.9%
CL-OP47H 733 -1.1%
GEM-38FH 676 -1%
CL-OP47 586 -0.5%
INKL 531
CL-OP46 497
CL-OP48 490 -0.2%
GLM-52 897
GPT-56SC 873
CL-OP5X 865 -0.9%
GROK-46H 865 -0.9%
GEM-37FH 865 -0.9%
GPT-56T 861
GLM-5 856
MUSE-SPK 841
QWEN-38X 824 -2.3%
GPT-6A 820
KIMI-K3X 810 -1%
CL-FAB5H 787 -0.9%
CL-OP5H 764 -0.9%
CL-OP46H 742 -0.9%
CL-OP47H 733 -1.1%
GEM-38FH 676 -1%
CL-OP47 586 -0.5%
INKL 531
CL-OP46 497
CL-OP48 490 -0.2%
← Back to feed

OpenRouter Replaces Benchmark Routing With Market Spend: 55 Trillion Weekly Tokens Now Drive Model Selection

OpenRouter has replaced the benchmark-based logic inside its Auto router with a system that learns from where developers actually spend money. The update to openrouter/auto — live for all users as of August 10 — draws on 55 trillion tokens routed weekly to build a continuously updated picture of which models developers choose for which tasks at which price points.

The previous router used benchmark rankings to make model selection decisions. The new approach inverts the logic: rather than asking which model scores highest on evaluation suites, it asks which model the market has collectively decided is worth paying for in production. OpenRouter calls this the “wisdom of the market.”

How It Works

The router classifies each incoming request by task type, then references the prior seven days of OpenRouter spend data to select the model that market behaviour suggests is the best fit for that task and cost tier. Because the index rolls on a weekly window, newly released models become eligible for routing almost immediately after they attract meaningful traffic, without waiting for evaluation results.

The company tested the approach in beta with thousands of users over several weeks before rolling it out to all accounts. In published benchmark comparisons, the market-spend router outperforms the prior version across tasks including reasoning, coding, instruction following, and data analysis at multiple cost levels.

Early-access users can target openrouter/auto-beta to receive future iterations of the router before general release.

Why It Matters

The approach sidesteps a known problem with benchmark-based routing: leaderboard rankings reflect controlled evaluation conditions, not production performance on real developer queries. A model that tops SWE-bench under a specific harness may not be the best choice for a production agent loop at $0.50 per task.

OpenRouter sees enough token volume — 55 trillion per week — that spend patterns are statistically meaningful at fine granularity. A model that wins majority spend in, say, multi-turn customer support queries at under $1 per task is revealed preference, not benchmark arithmetic.

The shift also makes the router self-updating. When a new frontier model launches and captures developer spend within days, the router adjusts without a manual update. When a model degrades in quality or raises prices and developers move away, the router tracks that too.

What Stays the Same

The model catalog, pricing, and all existing API endpoints remain unchanged. Developers calling openrouter/auto get the new routing logic automatically. There is no migration required.

The full list of eligible models and the spend data that informs routing are not published, but OpenRouter notes that any model with sufficient token volume in the trailing seven days is eligible for selection.