Why We Chose TypeScript Over Python for the World's Fastest AI Gateway Discover how TypeScript powers the world's fastest AI Gateway, delivering sub-10ms latency at scale. Performance meets flexibility in open-source AI infrastructure.
Open Sourcing Guardrails on the Gateway Framework We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
Partnering with F5 to Productionize Enterprise AI We are thrilled to announce that Portkey is partnering with F5, the creators of NGINX and global leader in multi-cloud application security & delivery, to bring enterprise AI apps to production. By integrating our AI Gateway and Observability Suite with F5 Distributed Cloud Services, we are accelerating the path to production
⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM) APIs. A
🌖 Announcing $3M Seed Round to Bring LLMs to Production Portkey is building a full-stack LLMOps platform that empowers AI builders to productionize their Gen AI apps reliably and securely.
My Journey with AI-Driven Development: From Curiosity to Necessity As I reflect upon my last 1 year coding journey, I am struck by how deeply Artificial Intelligence (AI) has woven itself into my development practices. From the likes of GitHub Copilot to the genius behind ChatGPT, my approach to writing code has undergone a transformative shift. Allow me to