Sign in Subscribe

Portkey

OpenAI’s Prompt Caching: A Deep Dive

OpenAI’s Prompt Caching: A Deep Dive

This update is welcome news for developers who have been grappling with the challenges of managing API costs and response times. OpenAI's Prompt Caching introduces a mechanism to reuse recently seen input tokens, potentially slashing costs by up to 50% and dramatically reducing latency for repetitive tasks. In this post,

Portkey in September

Portkey in September

New security goodies, cool APIs, and more AI models supported. Plus, we're teaming up with MongoDB and LibreChat.

Why We Chose TypeScript Over Python for the World's Fastest AI Gateway

Discover how TypeScript powers the world's fastest AI Gateway, delivering sub-10ms latency at scale. Performance meets flexibility in open-source AI infrastructure.

DSPy in Production

DSPy in Production

This is a guest post by Ganaraj, based on the talk he gave at the LLMs in Prod Meetup in Bangalore. AI has fundamentally changed the way we build apps. I transitioned from being a coder to a creative prompter. This shift from coding to creative prompting might seem like

Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps

Bridging the Gap: How Portkey AI Gateway Connected with MongoDB Helps Productionize AI Apps

Portkey’s open-source AI Gateway is used by thousands of AI companies to take their apps to production. Learn how these companies tackle crucial LLM challenges and build apps that delight users.

Building a Robust RAG App with Guardrails using Portkey and MongoDB

Building a Robust RAG App with Guardrails using Portkey and MongoDB

Introduction Retrieval-Augmented Generation (RAG) has become a go-to technique for enhancing LLMs with external data. In this tutorial, we'll build a production-ready RAG application in just 10 minutes using Portkey, MongoDB Atlas, Patronus AI, and LlamaIndex. But first, what is RAG? Retrieval-Augmented Generation (RAG) is a technique that enhances LLMs

Bring Your Agents to Production

Bring Your Agents to Production with Portkey

Portkey now natively integrates with Langchain, CrewAI, Autogen and other major agent frameworks, and makes your agent workflows production-ready.