Deep Dive: OpenAI's o1 - The Dawn of Deliberate AI
December 2024 marks a pivotal moment in AI development with the release of OpenAI's o1 system card, revealing an AI that thinks before it speaks. Let's explore how this changes everything..
Rohit Agarwal
Benchmarking the new moderation model from OpenAI
OpenAI's new "omni-moderation-latest" model shows significant improvements over the legacy model, especially in multilingual performance and image moderation.
We benchmark it's capabilties with it's predecessor.
Open Sourcing Guardrails on the Gateway Framework
We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
Partnering with F5 to Productionize Enterprise AI
We are thrilled to announce that Portkey is partnering with F5, the creators of NGINX and global leader in multi-cloud application security & delivery, to bring enterprise AI apps to production.
By integrating our AI Gateway and Observability Suite with F5 Distributed Cloud Services, we are accelerating the path to production
April Cool: 154 PR Merges
I sat down to count our PRs for the last month - 154 PRs merged, resulting in a total of 30 distinct updates. (that's 1 every day). I think we can do more! But we'll compensate for that with what we are shipping this month. 👀
In the meanwhile, here's a
⭐️ Implementing FrugalGPT: Reducing LLM Costs & Improving Performance
FrugalGPT is a framework proposed by Lingjiao Chen, Matei Zaharia, and James Zou from Stanford University in their 2023 paper "FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance". The paper outlines strategies for more cost-effective and performant usage of large language model (LLM) APIs.
A
What It Means To Go To Prod
Lately, I am feeling more and more confident about Portkey solving *real* production challenges for our users.
Of course, developer love and revenue increase are important parameters, but there's something else just as high signal:
The platform modularity that customers demand from Portkey, and how fast we serve it without