LLMs
Supported LLMs
Portkey connects with all major LLM providers and orchestration frameworks.
Supported AI Providers
Click to read their getting started guides.
OpenAI
Azure OpenAI
Anthropic
Cohere
Anyscale
AWS Bedrock
Vertex AI
Google Gemini
Google Palm
Together AI
Perplexity AI
Mistral AI
Stability AI
Nomic AI
AI21
DeepInfra
Ollama
Groq
Jina AI
Byollm
Fireworks AI
MonsterAPI
LocalAI
Predibase
ZhipuAI
Moonshot
Openrouter
Workers AI
Voyage-AI
AI21
DeepSeek
siliconflow
deepbricks
Lingyi (01.ai)
Endpoints Supported
For a detailed breakdown of supported endpoints and features per provider, refer to the table below:
Supported Providers
Supported Frameworks
Portkey has native integrations with the following frameworks. Click to read their getting started guides.
Have a suggestion for an integration with Portkey? Tell us on Discord, or drop a message on [email protected].
While you’re here, why not give us a star? It helps us a lot!
Was this page helpful?