Open Sourcing Guardrails on the Gateway Framework
We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
OpenAI
Supercharging Open-source LLMs: Your Gateway to 250+ Models
The Rise of Open-source LLMs in Production
Portkey Goes Multimodal
2024 is the year where Gen AI innovation and productisation happens hand-in-hand.
We are seeing companies and enterprises move their Gen AI prototypes to production at a breathtaking pace. At the same time, an exciting new shift is also taking place in how you can interact with LLMs: completely new
Understanding RAG: A Deeper Dive into the Fusion of Retrieval and Generation
Retrieval-Augmented Generation (RAG) models represent a fascinating marriage of two distinct but complementary components: retrieval systems and generative models. By seamlessly integrating the retrieval of relevant information with the generation of contextually appropriate responses, RAG models achieve a level of sophistication that sets them apart in the realm of artificial
⭐️ Getting Started with Llama 2
It's been some time since Llama 2's celebrated launch and we've seen the dust settle a bit and real use cases come to life.
In this blog post, we answer frequently asked questions on Llama 2's capabilities and when should you be using it. Let's dive in!
What is Llama
⭐ Building Reliable LLM Apps: 5 Things To Know
In this blog post, we explore a roadmap for building reliable large language model applications. Let’s get started!
⭐ Reducing LLM Costs & Latency with Semantic Cache
Implementing semantic cache from scratch for production use cases.