Portkey Docs home page
Latest
Search...
⌘K
Ask AI
Support
Book Demo
Sign in
Sign in
Search...
Navigation
LLM Integrations
Overview
Documentation
Integrations
Inference API
Admin API
Cookbook
Changelog
Ecosystem
Integrations
Submit an Integration
LLM Integrations
Overview
OpenAI
Anthropic
Google Gemini
Google Vertex AI
Azure
Bedrock
AWS SageMaker
Ollama
More
Bring Your Own LLM
Cloud Platforms
Microsoft Azure
Guardrails
Aporia
Acuvity
Azure Guardrails
AWS Bedrock Guardrails
Lasso Security
Mistral
Pangea
Patronus AI
Palo Alto Networks Prisma AIRS
Pillar
Prompt Security
Bring Your Own Guardrails
Plugins
Exa Online Search
Vector Databases
Milvus
Qdrant
Agents
Overview
OpenAI Agents SDK (Python)
OpenAI Agents SDK (TypeScript)
Autogen
Agno AI
Control Flow
CrewAI
Langchain Agents
Langroid
LangGraph
LiveKit
Llama Agents by Llamaindex
OpenAI Swarm
Pydantic AI
Phidata
Strands Agents
Bring Your own Agents
AI Apps
Overview
AnythingLLM
Claude Code
Anthropic Computer Use
Cline
Cursor
Langflow
Goose
Jan
Librechat
n8n
OpenAI Codex CLI
Open WebUI
Roo Code
Zed
Libraries
Overview
Autogen (DEPRECATED)
DSPy
Instructor
Langchain (Python)
Langchain (JS/TS)
LlamaIndex (Python)
Promptfoo
Vercel
MindsDb
ToolJet
MongoDB
Supabase
Zed
Portkey with Any OpenAI Compatible Project
Microsoft Semantic Kernel
Tracing Providers
Arize Phoenix
Pydantic Logfire
FutureAGI
Langfuse
Langsmith
Phoenix(Arize) Open-Telemetry
Pydantic Logfire
MLflow Tracing
OpenLIT
OpenTelemetry Python SDK
Traceloop (OpenLLMetry)
On this page
Supported AI Providers
Endpoints Supported
Supported Frameworks
LLM Integrations
Overview
Copy page
Portkey connects with all major LLM providers and orchestration frameworks.
Copy page
Supported AI Providers
OpenAI
Anthropic
Azure OpenAI
AWS Bedrock
Cohere
Google Gemini
Vertex AI
Perplexity AI
AI21
Anyscale
Byollm
Dashscope
Deepbricks
DeepInfra
DeepSeek
Fireworks AI
Github Models
Google Palm
Groq
Jina AI
Lambda
Lemonfox AI
Lepton AI
Lingyi (01.ai)
LocalAI
Mistral AI
MonsterAPI
Moonshot
nCompass
Nebius
Nomic AI
Nscale
Ollama
Openrouter
Predibase
Recraft AI
Siliconflow
Snowflake Cortex
Stability AI
Together AI
Triton
Upstage
Voyage-AI
Workers AI
ZhipuAI
Endpoints Supported
For a detailed breakdown of supported endpoints and features per provider, refer to the table below:
Supported Providers
Supported Frameworks
Portkey has native integrations with the following frameworks. Click to read their getting started guides.
Langchain
LlamaIndex
Autogen
Vercel
Instructor
DSPy
Promptfoo
Have a suggestion for an integration with Portkey? Tell us on
Discord
, or drop a message on
[email protected]
.
While you’re here, why not
give us a star
? It helps us a lot!
Was this page helpful?
Yes
No
Suggest edits
Raise issue
Submit an Integration
OpenAI
Assistant
Responses are generated using AI and may contain mistakes.