Comment on page
📖
LLM Providers
Portkey supports multiple providers through its official SDK as well as the SDKs of the respective providers. Along with this, Portkey also natively integrates with multiple LLM providers through its rest API and through integrations with projects like Langchain and Llamaindex.
Provider | Portkey SDK | Client SDK (Python) | Client SDK (Node) |
|---|---|---|---|
OpenAI | ✅ | ✅ | ✅ |
Azure OpenAI | ✅ | ✅ | ✅ |
Anthropic | ✅ | ✅ | ✅ |
Cohere | ✅ | 🚧 | 🚧 |
Anyscale | ✅ | N/A | N/A |
Hugging Face (invite-only) | - | - | - |
Anyscale (invite-only) | - | - | - |
Provider | Rest API | SDK |
|---|---|---|
OpenAI | ChatCompletions, Completions, Embed, Images, Audio, Files, Fine-tunes, Moderations, Edits | ChatCompletions, Completions |
Azure OpenAI | ChatCompletions, Completions, Embed, Images, Audio, Files, Fine-tunes, Moderations, Edits | ChatCompletions, Completions |
Anthropic | Completions | Completions |
Cohere | Generate, Embed, Classify, Tokenize, Detokenize, Detect-language, Summarise, Rerank | Generate |
Anyscale | Chat | Chat |
Hugging Face | Inference | (In Beta) |
Anyscale | (In Beta) | (In Beta) |
Please Note: This table will be regularly updated as we continue to expand our support for various LLM providers and their functions. Some of the unavailable functions might already be in beta. Do reach out on Discord if you need something which is missing here.
If you have any questions about LLM support or if you're interested in a provider or function that's not currently listed, please reach out on Discord or send us a mail. We're always looking to enhance our offerings based on your needs.
Last modified 1mo ago