Comment on page
🚪
AI Gateway
This is the most important functionality that Portkey provides, and also where Portkey solve the most impactful production challenges for your LLM app.
When your requests fail for no reason or due to server overload, Portkey automatically retries your requests with exponential backoff, ensuring that the request gets served.
When your app is running at scale, you are likely to encounter identical requests you have already served previously. By caching, you can save up on costs for such requests and serve them 20x times faster.
In cases of primary model being down, automatically send your request to a fallback model, ensuring reliability.
This unique feature helps you stay within your rate limit and queuing thresholds by distributing your requests across different model/providers and different accounts of the same providers
Unified Interface
Connect to all AI providers through a unified API. Simplify interactions and minimize integration hassles.
Last modified 1mo ago