Product Feature Comparison
Portkey processes billions of tokens everyday for our customers worldwide. All these requests are routed through our AI Gateway. We've open sourced this core AI Gateway that we use internally, to the community.
While Portkey itself has a generous free tier (10k requests free / month), if you are considering using the open source Gateway in your projects instead, here's a handy guide illustrating the key differences between Portkey's hosted app and the open source Gateway that powers it:
Product | Feature | Open Source | Dev (Free Forever) | Pro ($49/Month) | Enterprise (Custom) |
---|---|---|---|---|---|
Get Started | - | ||||
Requests per Month | - | No Limit | 10K | 100K | Unlimited |
Overage | - | - | None | $9/Month for Every 100K Up to 3M Requests | - |
Observability | |||||
Logs | ❌ | ✅ | ✅ | ✅ | |
Traces | ❌ | ✅ | ✅ | ✅ | |
Feedback | ❌ | ✅ | ✅ | ✅ | |
Custom Metadata | ❌ | ✅ | ✅ | ✅ | |
Filters | ❌ | ✅ | ✅ | ✅ | |
Alerts | ❌ | ❌ | ✅ | ✅ | |
Retention Period | ❌ | 3 Days | 30 Days | Custom | |
AI Gateway | |||||
Universal API | ✅ | ✅ | ✅ | ✅ | |
Automatic Fallbacks | ✅ | ✅ | ✅ | ✅ | |
Loadbalancing | ✅ | ✅ | ✅ | ✅ | |
Automatic Retries | ✅ | ✅ | ✅ | ✅ | |
Request Timeouts | ✅ | ✅ | ✅ | ✅ | |
Config Management | ❌ | ✅ | ✅ | ✅ | |
Virtual Keys & Key Management | ❌ | ✅ | ✅ | ✅ (with Budgeting support) | |
Simple Caching | ❌ | ✅ 1 Day TTL No Streaming | ✅ Unlimited TTL Stream from Cache | ✅ Unlimited TTL Stream from Cache | |
Semantic Caching | ❌ | ❌ | ✅ Unlimited TTL Stream from Cache | ✅ Unlimited TTL Stream from Cache | |
Support for AWS, GCP, Azure Private LLM Deployments | ❌ | ❌ | ❌ | ✅ | |
Prompt Management | |||||
Prompt Templates | ❌ | ✅ Up to 3 Templates | ✅ Unlimited | ✅ Unlimited | |
Playground | ❌ | ✅ | ✅ | ✅ | |
API Deployment | ❌ | ✅ | ✅ | ✅ | |
Versioning | ❌ | ✅ | ✅ | ✅ | |
Variable Management | ❌ | ✅ | ✅ | ✅ | |
Guardrails | |||||
Eval Templates | ❌ | ✅ Limited Access | ✅ Unlimited | ✅ Unlimited | |
Autonomous Fine-Tuning | |||||
Continuous Improvement | ❌ | ❌ | ❌ | ✅ | |
Security & Compliance | |||||
Role Based Access Control | ❌ | ❌ | ✅ | ✅ (Advanced) | |
Team Management | ❌ | ✅ | ✅ | ✅ (Advanced) | |
SSO with Okta Auth | ❌ | ❌ | ❌ | ✅ | |
SOC2, ISO27001, GDPR, HIPAA Compliance Certificates | ❌ | ❌ | ❌ | ✅ | |
PII Anonymizer | ❌ | ❌ | ❌ | ✅ | |
BAA Signing for Compliances | ❌ | ❌ | ❌ | ✅ | |
VPC Managed Hosting | ❌ | ❌ | ❌ | ✅ | |
Private Tenancy | ❌ | ❌ | ❌ | ✅ | |
Configurable Retention Periods | ❌ | ❌ | ❌ | ✅ | |
Configurable exports to datalakes | ❌ | ❌ | ❌ | ✅ |
Last updated