Sign in Subscribe

Rohit Agarwal

Benchmarking the new moderation model from OpenAI

Benchmarking the new moderation model from OpenAI

OpenAI's new "omni-moderation-latest" model shows significant improvements over the legacy model, especially in multilingual performance and image moderation. We benchmark it's capabilties with it's predecessor.

Open Sourcing Guardrails on the Gateway Framework

We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.

Partnering with F5 to Productionize Enterprise AI

Partnering with F5 to Productionize Enterprise AI

We are thrilled to announce that Portkey is partnering with F5, the creators of NGINX and global leader in multi-cloud application security & delivery, to bring enterprise AI apps to production. By integrating our AI Gateway and Observability Suite with F5 Distributed Cloud Services, we are accelerating the path to production

April Cool: 154 PR Merges

April Cool: 154 PR Merges

I sat down to count our PRs for the last month - 154 PRs merged, resulting in a total of 30 distinct updates. (that's 1 every day). I think we can do more! But we'll compensate for that with what we are shipping this month. 👀 In the meanwhile, here's a

⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance

⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance

FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM) APIs. A

What It Means To Go To Prod

What It Means To Go To Prod

Lately, I am feeling more and more confident about Portkey solving *real* production challenges for our users. Of course, developer love and revenue increase are important parameters, but there's something else just as high signal: The platform modularity that customers demand from Portkey, and how fast we serve it without

Portkey Goes Multimodal

Portkey Goes Multimodal

2024 is the year where Gen AI innovation and productisation happens hand-in-hand. We are seeing companies and enterprises move their Gen AI prototypes to production at a breathtaking pace. At the same time, an exciting new shift is also taking place in how you can interact with LLMs: completely new