June at Portkey: Agents, AI Governance, and Twenty Six Cookbooks
AI Governance features, Telemetry for Agents, Cookbooks, Claude 3.5, and more.
Vrushank Vyas
May: Major Updates
Set budget & rate limits, streamline team permissions, GPT-4o, Gemini Flash, Instructor & Promptfoo integrations, and more.
Portkey Goes Multimodal
2024 is the year where Gen AI innovation and productisation happens hand-in-hand.
We are seeing companies and enterprises move their Gen AI prototypes to production at a breathtaking pace. At the same time, an exciting new shift is also taking place in how you can interact with LLMs: completely new
Unpacking Semantic Caching at Walmart
Last month, the LLMs in Prod community had the pleasure of hosting Rohit Chatter, Chief Software Architect at Walmart Tech Global, for a fireside chat on Gen AI and semantic caching in retail. This conversation spanned a wide range of topics, from Rohit's personal journey in the tech industry to
⭐️ OpenAI Model Deprecation Guide
In two days (i.e. Jan 4), OpenAI will retire 33 models, including GPT-3 (text-davinci-003) and various others. This is OpenAI's biggest model deprecation so far. Here's what you need to know:
GPT-3 Model Retirement
The text-davinci-003 model (commonly known as GPT-3) will be unavailable from Jan 4.
→ You must
Building Production-Ready RAG Apps
💡This is Portkey's first collaboration with the Hasura Team.
Hasura helps you build robust RAG data pipelines by unifying multiple private data sources (relational DB, vector DB, etc.) and letting you query the data securely with production-grade controls.
LLMs have been around for some time now and have shown that
GPT-4 is Getting Faster 🐇
Over the past few months, we've been keenly observing latencies for both GPT 3.5 & 4. The emerging patterns have been intriguing.
The standout observation? GPT-4 is catching up in speed, closing the latency gap with GPT 3.5.
Our findings reveal a consistent decline in GPT-4 latency. While your