Why We Chose TypeScript Over Python for the World's Fastest AI Gateway
Discover how TypeScript powers the world's fastest AI Gateway, delivering sub-10ms latency at scale. Performance meets flexibility in open-source AI infrastructure.
Production Guides
DSPy in Production
This is a guest post by Ganaraj, based on the talk he gave at the LLMs in Prod Meetup in Bangalore.
AI has fundamentally changed the way we build apps. I transitioned from being a coder to a creative prompter. This shift from coding to creative prompting might seem like
Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps
Portkey’s open-source AI Gateway is used by thousands of AI companies to take their apps to production. Learn how these companies tackle crucial LLM challenges and build apps that delight users.
Building a Robust RAG App with Guardrails using Portkey and MongoDB
Introduction
Retrieval-Augmented Generation (RAG) has become a go-to technique for enhancing LLMs with external data. In this tutorial, we'll build a production-ready RAG application in just 10 minutes using Portkey, MongoDB Atlas, Patronus AI, and LlamaIndex.
But first, what is RAG?
Retrieval-Augmented Generation (RAG) is a technique that
Attention Isn’t All You Need
Mamba: The AI that remembers like a Transformer but thinks like an RNN. Its improved long-term memory could revolutionize DNA processing, video analysis, and AI agents with persistent goals.
Bring Your Agents to Production with Portkey
Portkey now natively integrates with Langchain, CrewAI, Autogen and other major agent frameworks, and makes your agent workflows production-ready.
Portkey x Pillar - Enterprise-grade Security for LLMs in Production
Bringing Pillar's AI guardrails onboard Portkey's open source Gateway!