Portkey Features
Explore the powerful features of Portkey
AI Gateway
Connect to 250+ AI models using a single consistent API. Set up load balancers, automated fallbacks, caching, conditional routing, and more, seamlessly.
๐ Universal API
Integrate with multiple AI models through a single API
๐พ Caching
Implement simple and semantic caching for improved performance
๐ Fallbacks
Set up automated fallbacks for enhanced reliability
๐ Multimodal Capabilities
Handle various data types with multimodal AI capabilities
๐ Automatic Retries
Implement automatic retries for improved resilience
โ๏ธ Load Balancing
Distribute workload efficiently across multiple models
๐ Virtual Keys
Manage access with virtual API keys
โฑ๏ธ Request Timeouts
Set and manage request timeouts
๐ค Canary Tests
Implement canary testing for safe deployments
๐ฆ Conditional Routing
Route requests based on specific conditions
๐ณ Budget Limits
Set and manage budget limits
Observability & Logs
Gain real-time insights, track key metrics, and streamline debugging with our OpenTelemetry-compliant system.
๐ Logs
Access and analyze detailed logs
๐ต๏ธ Tracing
Implement distributed tracing for request flows
๐ Analytics
Gain insights through comprehensive analytics
๐งช Filters
Apply filters for targeted analysis
๐ท๏ธ Metadata
Manage and utilize metadata effectively
๐ฌ Feedback
Collect and analyze user feedback
Prompt Library
Collaborate with team members to create, templatize, and version prompt templates easily. Experiment across 250+ LLMs with a strong Publish/Release flow to deploy the prompts.
๐งฉ Prompt Templates
Create and manage reusable prompt templates
โ๏ธ Prompt Partials
Utilize modular prompt components
{ } JSON Mode Prompting
Advanced prompting with JSON mode
Guardrails
Enforce Real-Time LLM Behavior with 50+ state-of-the-art AI guardrails, so that you can synchronously run Guardrails on your requests and route them with precision.
๐ก๏ธ Deterministic Guardrails
Implement rule-based safety checks
๐ค LLM-based Guardrails
Leverage AI for advanced content filtering
๐ค Partner Guardrails
Integrate third-party safety solutions
๐ Bring Your Own
Customize guardrails to your needs
Agents
Natively integrate Portkeyโs gateway, guardrails, and observability suite with leading agent frameworks and take them to production.