Documentation Index
Fetch the complete documentation index at: /docs/llms.txt
Use this file to discover all available pages before exploring further.

Skip to main content

🚀 Introducing Agent Gateway — governance, observability, and control for your AI agents. Register for live webinar ↗

Portkey Docs home page

Models
Support
Contact Us
Sign in
Sign in

Evals

How to Run Structured Output Evals at Scale
Building an LLM-as-a-Judge System for AI (Customer Support) Agent

Prompt Engineering

Prompts
Ultimate AI SDR
Build a chatbot using Portkey's Prompt Templates
Building an LLM-as-a-Judge System for AI (Customer Support) Agent
Optimizing Prompts for Customer Support using Portkey | LLama Prompt Ops Integration

Whitepapers

Getting Started

Overview
A/B Test Prompts and Models
Tackling Rate Limiting
Function Calling
Image Generation
Getting Started with AI Gateway
Llama 3 on Groq
Return Repeat Requests from Cache
Trigger Automatic Retries on LLM Failures
101 on Portkey's Gateway Configs

Integrations

Overview
Portkey CLI
Skills Registry
Llama 3 on Portkey + Together AI
Introduction to GPT-4o
Anyscale
Mistral
Vercel AI
Deepinfra
Groq
Langchain
Mixtral 8x22b
Segmind
Sync Open WebUI Feedback → Portkey

Use Cases

Overview
Unified LLM API with Automatic Failover & Error Handling
Multi-Tenant LLM Access with Enterprise Control for Customer-Facing Apps
Enforcing Budget, Token & Rate Limits: Use Cases
Testing Application Resilience with Fallbacks
How to use Portkey Guardrails for PII Protection
Creating your own partner guardrails
Handle streaming output guardrails for client-side decisions
Web Search for Any LLM in LibreChat
Few-Shot Prompting
Enforcing JSON Schema with Anyscale & Together
Detecting Emotions with GPT-4o
Build an article suggestion app with Supabase pgvector, and Portkey
Setting up resilient Load balancers with failure-mitigating Fallbacks
Combining Routing Strategies: Conditional, Load Balancing & Fallbacks
Run Portkey on Prompts from Langchain Hub
Smart Fallback with Model-Optimized Prompts
How to use OpenAI SDK with Portkey Prompt Templates
Setup OpenAI -> Azure OpenAI Fallback
Fallback from SDXL to Dall-e-3
Comparing Top10 LMSYS Models with Portkey
Request metadata use cases
Tracking LLM Costs Per User with Portkey
Comparing DeepSeek Models Against OpenAI, Anthropic & More Using Portkey
Portkey with OpenAI Computer Use
Using Private MCP Servers with Responses API
Converting STDIO to Remote MCP Servers

Integrations

Overview

Llama 3 on Portkey + Together AI

Introduction to GPT-4o

Anyscale

Mistral

Vercel AI

Deepinfra

Groq

Langchain

Mixtral 8x22b

Segmind

Portkey is now PRISMA AIRS AI Gateway. See it in action.

Contact Us

Last modified on August 3, 2026

Was this page helpful?

Suggest edits Raise issue

101 on Portkey's Gateway Configs

Portkey CLI

⌘I

Portkey Docs home page

x linkedin discord github

For LLMs

llms.txt llms-full.txt

Products

Observability AI Gateway Guardrails Prompt Management Agents MCP Gateway Security Auto-Instrumentation

Resources

API Status Helm Charts AI Grants Finder Events Calendar Support Forum Blog Error Library Models & Pricing

Company

Pricing Compliances Privacy Policy Terms of Service DPA Cookie Policy

Powered byThis documentation is built and hosted on Mintlify, a developer documentation platform