ModelsAgree
← All leaderboards

Not Diamond

What ChatGPT, Claude, Gemini & Grok actually say · September 2026

Visit notdiamond.ai ↗

The verdict

Not Diamond appears in 4 AI-ranked categories — best position #1 for llm routers for cost-aware model selection.

GPT #2Claude #3Gemini #1Grok #2

State-of-the-art commercial intelligent router that uses dynamic prompt classification to route queries to the cheapest model satisfying user-defined quality thresholds. Assumes teams prioritize maximum cost savings and turnkey SaaS convenience over self-hosted infrastructure.

GPT Better once you have scored production examples. It offers a strong pre-trained router, custom routers trained on your data, custom endpoints, and cost, quality, or latency optimization.

Grok Commercial learned router that trains or uses preference/production data to select the cheapest capable model (or effort level) per step, delivering documented 20-61% cost cuts with maintained or higher quality especially on coding agents and multi-turn sessions; simple API/SDK integration, SOC2/ISO, and custom routers give practitioners immediate production ROI without building the decision layer

Claude Purpose-built per-query router that predicts the best model on a quality/cost frontier and supports custom-trained routers on your own data and preferences; strong independent eval results and a clean API make intelligent routing accessible without building the ML yourself.

Where Not Diamond falls short, per the models

  • GPT It selects the model rather than replacing your inference gateway, and custom routing needs a representative evaluation set.
  • Claude Smaller ecosystem and you're trusting an opaque routing model plus an extra decision-latency hop; less compelling if you want full transparency or already know which model each request needs.
  • Gemini Closed-source cloud API dependency that introduces extra network hops and compliance friction for strict data residency requirements.
  • Grok SaaS with routing fees and third-party dependency; not for teams that must keep all routing logic and data fully on-prem or zero external calls

Poll history — On this board 2 of 2 polls since Aug 3 · now #2

#1 → #2

Top alternatives per the models: LiteLLM · OpenRouter · RouteLLM · Microsoft Foundry Model Router

Claude #3Gemini #1

Best-in-class predictive ML routing that dynamically selects models based on prompt complexity; enables practitioners to set explicit cost, latency, and accuracy Pareto targets with minimal routing latency overhead and drop-in client integration.

Claude The most credible learned, quality-aware router — trains/serves a router that predicts the best model per query and lets you set explicit cost and latency constraints, consistently beating single-model baselines on cost-for-quality; the closest thing to true "automatic" optimization.

Where Not Diamond falls short, per the models

  • Claude You depend on its trained routers and evaluation assumptions (a black box you must trust and re-tune as models change); overkill for anyone who just needs a cheap unified endpoint.
  • Gemini Closed-source commercial platform with proprietary routing logic; unsuitable for strictly air-gapped environments or teams that prohibit third-party request mediation.

Top alternatives per the models: OpenRouter · LiteLLM · Portkey · RouteLLM

#3🔀 Best LLM inference router3/4 models · updated 2026-07-15
GPT #2Claude #5Gemini #1Grok —

Leading dynamic meta-router utilizing ML classifiers to evaluate prompts in real-time, directing requests to the optimal model based on cost, quality, and latency constraints while supporting custom evaluation datasets.

GPT Strongest dedicated routing-intelligence layer: pre-trained chat and coding routers, custom routers learned from your evaluation data, and per-request quality, cost, or latency optimization; it is the better choice than OpenRouter when routing accuracy should adapt to a specific workload.

Claude The strongest true per-prompt router — trains custom routers on your own evals to send each request to the best model while jointly optimizing quality, cost, and latency, delivering real savings versus always calling a frontier model; ranked here on capability in the literal "best model per request" sense rather than adoption.

Where Not Diamond falls short, per the models

  • GPT It selects the model but is not a complete one-key inference gateway, so you must operate or integrate the execution, credentials, billing, and observability layer yourself.
  • Claude Niche traction and a black-box router you must trust with eval data; it is not a full gateway (no key management, budgets, or observability), so most teams pair it with one of the options above.
  • Gemini It introduces latency overhead from classifier runs and requires sending prompt data to a third-party hosted service, raising compliance concerns for sensitive data.

Poll history — On this board 1 of 2 polls since Jul 13 — off it in the latest

#2 → –

Top alternatives per the models: OpenRouter · LiteLLM · Portkey · Vercel AI Gateway

#4🔀 Best LLM router3/4 models · updated 2026-08-23
GPT #4Claude #4Gemini —Grok #3

Specialized predictive router that selects the optimal model per prompt (especially strong for coding agents and long-horizon workloads), delivering documented cost savings and accuracy gains while remaining gateway-agn

GPT Best specialist intelligent model selector: routes each prompt according to predicted model quality while optimizing cost or latency, supports pretrained and custom routers, and is particularly compelling for coding-agent workloads where per-request model choice can materially cut frontier-model spend.

Claude Best true "intelligent" router—rather than just proxying, it predicts the best model per prompt on a quality/cost/latency frontier from evals, and can train a router on your own data; genuinely lowers cost while holding quality when your traffic is heterogeneous.

Where Not Diamond falls short, per the models

  • GPT Its model-selection layer and supported routing universe are narrower than general gateways such as OpenRouter/LiteLLM, so it is not the best universal infrastructure abstraction.
  • Claude It decides which model, not a full multi-provider access layer—you still pair it with a gateway/keys, and its gains depend on representative eval data; poor fit if you already know which model you want.

Top alternatives per the models: LiteLLM · OpenRouter · Portkey · RouteLLM

Head-to-head — how the models call it

Watch Not Diamond

Boards re-poll weekly and the models change their minds. One short email only when Not Diamond's standing moves — a rank change, a rival overtaking, or new reasoning from the models. Nothing otherwise.

Embed your ranking badge

Not Diamond ranks #1 for best llm routers for cost-aware model selection by AI-model consensus. Put the badge in your README, docs or site — it updates automatically as the models re-rank.

Not Diamond — ranked #1 for Best LLM routers for cost-aware model selection by AI models on ModelsAgree
Markdown (README)
[![Not Diamond — ranked #1 for Best LLM routers for cost-aware model selection by AI models on ModelsAgree](https://modelsagree.com/badge/not-diamond.svg)](https://modelsagree.com/best/best-llm-routers-for-cost-aware-model-selection?utm_source=badge&utm_medium=embed&utm_campaign=badge-not-diamond)
HTML
<a href="https://modelsagree.com/best/best-llm-routers-for-cost-aware-model-selection?utm_source=badge&utm_medium=embed&utm_campaign=badge-not-diamond"><img src="https://modelsagree.com/badge/not-diamond.svg" alt="Not Diamond — ranked #1 for Best LLM routers for cost-aware model selection by AI models on ModelsAgree" height="28"></a>

Rankings are computed from what the models answer, re-polled on demand · raw reasoning shown verbatim · methodology