Portkey Features
Explore the powerful features of Portkey
AI Gateway
Connect to 250+ AI models using a single consistent API. Set up load balancers, automated fallbacks, caching, conditional routing, and more, seamlessly.🌐 Universal API
Integrate with multiple AI models through a single API
💾 Caching
Implement simple and semantic caching for improved performance
🔄 Fallbacks
Set up automated fallbacks for enhanced reliability
🔀 Multimodal Capabilities
Handle various data types with multimodal AI capabilities
🔁 Automatic Retries
Implement automatic retries for improved resilience
🔌 Circuit Breaker
Configure per-strategy circuit protection and failure handling
⚖️ Load Balancing
Distribute workload efficiently across multiple models
🔑 Integrations
Manage access to LLMs
⏱️ Request Timeouts
Set and manage request timeouts
🐤 Canary Tests
Implement canary testing for safe deployments
🚦 Conditional Routing
Route requests based on specific conditions
💳 Budget Limits
Set and manage budget limits
Observability & Logs
Gain real-time insights, track key metrics, and streamline debugging with our OpenTelemetry-compliant system.📜 Logs
Access and analyze detailed logs
🕵️ Tracing
Implement distributed tracing for request flows
📊 Analytics
Gain insights through comprehensive analytics
🧪 Filters
Apply filters for targeted analysis
🏷️ Metadata
Manage and utilize metadata effectively
💬 Feedback
Collect and analyze user feedback
Prompt Library
Collaborate with team members to create, templatize, and version prompt templates easily. Experiment across 250+ LLMs with a strong Publish/Release flow to deploy the prompts.🧩 Prompt Templates
Create and manage reusable prompt templates
✂️ Prompt Partials
Utilize modular prompt components
{ } JSON Mode Prompting
Advanced prompting with JSON mode
Guardrails
Enforce Real-Time LLM Behavior with 50+ state-of-the-art AI guardrails, so that you can synchronously run Guardrails on your requests and route them with precision.🛡️ Deterministic Guardrails
Implement rule-based safety checks
🤖 LLM-based Guardrails
Leverage AI for advanced content filtering
🤝 Partner Guardrails
Integrate third-party safety solutions
🎒 Bring Your Own
Customize guardrails to your needs