Production Guides
Portkey in September
New security goodies, cool APIs, and more AI models supported. Plus, we're teaming up with MongoDB and LibreChat.
Production Guides
Production Guides
Why We Chose TypeScript Over Python for the World's Fastest AI Gateway
Discover how TypeScript powers the world's fastest AI Gateway, delivering sub-10ms latency at scale. Performance meets flexibility in open-source AI infrastructure.
Production Guides
DSPy in Production
This is a guest post by Ganaraj, based on the talk he gave at the LLMs in Prod Meetup in Bangalore. AI has fundamentally changed the way we build apps. I transitioned from being a coder to a creative prompter. This shift from coding to creative prompting might seem like
Production Guides
Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps
Portkey’s open-source AI Gateway is used by thousands of AI companies to take their apps to production. Learn how these companies tackle crucial LLM challenges and build apps that delight users.
Production Guides
Building a Robust RAG App with Guardrails using Portkey and MongoDB
Introduction Retrieval-Augmented Generation (RAG) has become a go-to technique for enhancing LLMs with external data. In this tutorial, we'll build a production-ready RAG application in just 10 minutes using Portkey, MongoDB Atlas, Patronus AI, and LlamaIndex. But first, what is RAG? Retrieval-Augmented Generation (RAG) is a technique that
Production Guides
Attention Isn’t All You Need
Mamba: The AI that remembers like a Transformer but thinks like an RNN. Its improved long-term memory could revolutionize DNA processing, video analysis, and AI agents with persistent goals.
Production Guides
Bring Your Agents to Production with Portkey
Portkey now natively integrates with Langchain, CrewAI, Autogen and other major agent frameworks, and makes your agent workflows production-ready.
Production Guides
Portkey x Pillar - Enterprise-grade Security for LLMs in Production
Bringing Pillar's AI guardrails onboard Portkey's open source Gateway!
Production Guides
Open Sourcing Guardrails on the Gateway Framework
We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
Production Guides
Portkey & Patronus - Bringing Responsible LLMs in Production
Patronus AI's suite of evaluators are now available on the Portkey Gateway.
Production Guides
Supercharging Open-source LLMs: Your Gateway to 250+ Models
The Rise of Open-source LLMs in Production
Production Guides
⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance
FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM)