June at Portkey: Agents, AI Governance, and Twenty Six Cookbooks AI Governance features, Telemetry for Agents, Cookbooks, Claude 3.5, and more.
⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM) APIs. A
Transforming E-Commerce Search with Semantic Cache: Insights from Walmart's Journey We recently spoke with Rohit Chatter, Chief Software Architect at Walmart, who offered profound insights into how Walmart is leveraging these technologies, particularly focusing on semantic caching and its impact on e-commerce search functions.