Portkey Features
Explore the powerful features of Portkey
AI Gateway
Connect to 250+ AI models using a single consistent API. Set up load balancers, automated fallbacks, caching, conditional routing, and more, seamlessly.π Universal API
Integrate with multiple AI models through a single API
πΎ Caching
Implement simple and semantic caching for improved performance
π Fallbacks
Set up automated fallbacks for enhanced reliability
π Multimodal Capabilities
Handle various data types with multimodal AI capabilities
π Automatic Retries
Implement automatic retries for improved resilience
π Circuit Breaker
Configure per-strategy circuit protection and failure handling
βοΈ Load Balancing
Distribute workload efficiently across multiple models
π Integrations
Manage access to LLMs
β±οΈ Request Timeouts
Set and manage request timeouts
π€ Canary Tests
Implement canary testing for safe deployments
π¦ Conditional Routing
Route requests based on specific conditions
π³ Budget Limits
Set and manage budget limits
Observability & Logs
Gain real-time insights, track key metrics, and streamline debugging with our OpenTelemetry-compliant system.π Logs
Access and analyze detailed logs
π΅οΈ Tracing
Implement distributed tracing for request flows
π Analytics
Gain insights through comprehensive analytics
π§ͺ Filters
Apply filters for targeted analysis
π·οΈ Metadata
Manage and utilize metadata effectively
π¬ Feedback
Collect and analyze user feedback
Prompt Library
Collaborate with team members to create, templatize, and version prompt templates easily. Experiment across 250+ LLMs with a strong Publish/Release flow to deploy the prompts.𧩠Prompt Templates
Create and manage reusable prompt templates
βοΈ Prompt Partials
Utilize modular prompt components
{ } JSON Mode Prompting
Advanced prompting with JSON mode
Guardrails
Enforce Real-Time LLM Behavior with 50+ state-of-the-art AI guardrails, so that you can synchronously run Guardrails on your requests and route them with precision.π‘οΈ Deterministic Guardrails
Implement rule-based safety checks
π€ LLM-based Guardrails
Leverage AI for advanced content filtering
π€ Partner Guardrails
Integrate third-party safety solutions
π Bring Your Own
Customize guardrails to your needs