Portkey

Where Portkey falls short, per the models

• GPT Its breadth adds configuration and operational complexity that small teams wanting a simple endpoint may not need.
• Claude Full feature set (governance, analytics, guardrails) sits behind the paid managed platform, and it's a smaller vendor than the hyperscalers — teams wanting purely OSS get a thinner slice than LiteLLM offers.
• Gemini Heavily dependent on Portkey's control plane, making full offline self-hosting complex and locking teams into their ecosystem.
• Grok Can introduce more overhead/complexity than pure performance-focused options; managed tiers have per-log pricing that scales with volume.

Where Portkey falls short, per the models

• GPT The best observability and enterprise workflow experience is tied to the wider Portkey platform rather than the standalone gateway alone.
• Claude The most valuable governance, analytics, and prompt-management features are oriented toward Portkey's hosted commercial plane — the pure self-hosted OSS gateway is more bare-bones than the marketing implies.
• Gemini Advanced management capabilities, enterprise guardrails, and compliance dashboards require coupling with Portkey's commercial cloud control plane.
• Grok Acquisition by Palo Alto Networks (2026) creates moderate long-term roadmap uncertainty for pure independent OSS users; deepest observability and prompt-management surfaces still pair most naturally with the hosted control plane.

Poll history — #2 in all 2 polls since Aug 3

#2 → #2

Where Portkey falls short, per the models

• GPT Its most polished management and enterprise capabilities favor the commercial platform, so it is not the best choice for teams requiring a wholly independent self-hosted stack
• Claude Full value (logs, guardrails, prompt tooling) lives in the hosted platform — self-hosting only the OSS gateway loses much of the point, so you're accepting a SaaS dependency in your inference path.
• Gemini Introduces vendor lock-in, adds an extra cost layer based on request volume, and represents platform overkill for simple prototypes or small applications.
• Grok Can feel feature-dense/overwhelming for simple use cases; some advanced enterprise features pricing-gated (near-tie with similar specialized gateways like Helicone/TrueFoundry on developer focus).

Poll history — On this board 2 of 2 polls since Jul 17 · now #1

#3 → #1

Where Portkey falls short, per the models

• GPT The most convenient management and enterprise capabilities pull users toward Portkey’s commercial control plane, so it is less cleanly independent than a fully self-managed stack.
• Claude Full value requires buying into the whole platform and its pricing; overkill if you only need simple routing and fallbacks.
• Gemini Its volume-based pricing model can scale costs rapidly, and the self-hosted version is significantly more complex to deploy and maintain compared to lightweight open-source options.
• Grok Broaden model catalog and simplify pricing for smaller teams to compete better on accessibility.

Poll history — On this board 9 of 9 polls since Jun 29 · #2 the last 3

#3 → #3 → #2 → #3 → #2 → #3 → #2 → #2 → #2

Where Portkey falls short, per the models

• GPT Its full platform is more complex and commercially opinionated than a lightweight routing layer.
• Claude The full feature set lives behind the paid managed platform; at small scale it's more product than you need, and pricing scales with request volume in a way solo practitioners rarely justify.
• Gemini Commercial platform dependency with advanced governance locked behind paid enterprise tiers.
• Grok Can be heavier/more complex for simple routing use cases compared to lighter proxies.

Where Portkey falls short, per the models

• GPT Semantic caching is paid/enterprise-oriented and ignores the first message when matching, making it unsuitable when changing system instructions must invalidate results.
• Claude Closed SaaS sitting in your request path with semantic caching gated to paid tiers, and limited control over embedding/threshold internals — not for infra-control purists or air-gapped deployments.
• Gemini Being primarily a commercial SaaS tool introduces potential vendor lock-in, data privacy concerns regarding prompt exposure to third-party endpoints, and higher subscription costs.
• Grok Less emphasized on raw performance/overhead compared to Bifrost; commercial aspects may add cost for heavy use.

Poll history — On this board 2 of 2 polls since Jul 12 · now #4

#2 → #4

Where Portkey falls short, per the models

• GPT The most useful budget-enforcement features are restricted to Enterprise and select Pro customers, reducing its value for smaller teams.
• Claude The meaningful governance features sit behind paid tiers, and you're adding a vendor in the hot path for something an open-source gateway does for free
• Gemini Forces application runtime traffic through a proprietary SaaS proxy or SDK integration which can introduce vendor dependency.
• Grok Some advanced features behind paid plans; self-host vs managed trade-offs add complexity for small teams.

Poll history — On this board 2 of 2 polls since Jul 13 · now #3

#4 → #3

Where Portkey falls short, per the models

• GPT Its core routing is principally policy- and metadata-driven rather than a learned predictor of which model will answer each prompt best.
• Claude Per-request pricing gets expensive at scale, and its routing is rule-driven — it won't decide which model is best for a given prompt on its own.
• Grok More setup for complex rules; observability/governance focus can feel heavier for simple prototyping vs pure routing.

Poll history — On this board 2 of 2 polls since Jul 13 · now #3

#4 → #3

Where Portkey falls short, per the models

• Gemini The advanced UI and control plane features are heavily tied to Portkey's cloud, making it harder to self-host compared to completely open-source alternatives.

Poll history — On this board 1 of 2 polls since Jul 13 — off it in the latest

#6 → –

Where Portkey falls short, per the models

• Gemini Forces application traffic through its proxy server, creating vendor lock-in and adding a critical point of failure to the production stack.

Poll history — On this board 6 of 9 polls since Jun 29 · #5 the last 2

#6 → – → #5 → – → #5 → #5 → – → #5 → #5

Where Portkey falls short, per the models

• Gemini Built primarily as an operational gateway and control plane rather than a predictive ML-based prompt routing engine.