Portkey
The control panel for production AI
Overview
Portkey's value is consolidating the operational plumbing of running LLMs in production — routing, logging, caching, guardrails, and governance — into one gateway layer instead of stitching together separate tools. Its open-source core plus a genuinely free-forever developer tier make it approachable for smaller teams to try before committing, and the jump to Production tier pricing is modest compared to enterprise-only competitors.
The tradeoff is that this is a crowded space — LiteLLM covers similar gateway ground as a free open-source option, and PromptLayer overlaps on prompt management and tracking. Portkey's strongest case is for teams that want one platform covering routing, observability, and governance together rather than piecing together multiple point tools; if you only need routing, a leaner open-source gateway may be cheaper.
Key Features
Universal API: Single interface to route requests across 100+ LLM providers.
Observability and logging: Full request/response logging with configurable retention windows.
Guardrails: Built-in content and safety checks to enforce policy before responses reach users.
Prompt management: Version and manage prompt templates directly in the platform.
Caching and routing: Reduce latency and cost with smart caching and automatic fallback routing.
Enterprise governance: SSO, VPC hosting, and SOC2/GDPR/HIPAA compliance at the top tier.
Pricing
Starting price
Free tier available (open source + free forever plan); Production from $49/mo
Open Source: Free, self-hosted universal API, routing, basic guardrails, community support.
Developer: Free forever, 10k recorded logs/month, 3-day retention, prompt templates, playground access.
Production: $49/month, 100k recorded logs/month, 30-day retention, unlimited prompt templates, caching, role-based access control; overages at $9 per additional 100k requests.
Enterprise: Custom pricing, 10M+ monthly logs, custom retention, advanced guardrails, SSO, VPC hosting, SOC2/GDPR/HIPAA compliance.
Disclaimer: pricing may change, confirm on Portkey's own pricing page before buying.
Pros
Open-source core: Free, self-hostable option for teams wanting full control.
All-in-one gateway: Combines routing, observability, guardrails, and prompt management in one place.
Enterprise-ready governance: SOC2/GDPR/HIPAA and VPC hosting support regulated deployments.
Approachable pricing: Free-forever developer tier and a reasonably priced $49/mo Production tier.
Cons
Short retention on lower tiers: Free tier's 3-day log retention limits usefulness for debugging over time.
Crowded market: Overlaps heavily with LiteLLM, PromptLayer, and other gateway/observability tools.
Overage fees: Additional charges per 100k requests beyond plan limits can add up for high-volume teams.
What Makes It Unique
Combined gateway and governance layer: Bundles routing, observability, guardrails, and compliance features together rather than requiring separate tools for each.
Kay Score
7.2
/ 10
Tool Information
Pricing
Free tier available (open source + free forever plan); Production from $49/mo
Category
Coding & Development
Platform
Web / iOS / Android
Last Updated
