LLMs In Prod: Day 1
This is Part 1 of our analysis diving into Portkey's year-end LLM production data. Over the next few days, we'll be unpacking insights from over 2 trillion tokens worth of production data to reveal how the AI ecosystem evolved in 2024.
Today, we're starting with the most crucial aspect: who's dominating the market, who's growing the fastest, and what's really changing in the LLM landscape.
✨LLMs in Prod Day 1: Provider Trends Unveiled
— Portkey (@PortkeyAI) December 12, 2024
Who’s dominating? Who’s growing the fastest? And what’s really changing in the AI ecosystem?
We analyzed 2 trillion tokens worth of our production data to uncover trends that might surprise you. Let’s get into it. 👇
OpenAI: Still Leading, But Watch Out
— Portkey (@PortkeyAI) December 12, 2024
• 24% monthly growth in requests
• 6% monthly growth in organizations
OpenAI remains the leader, but here’s the twist: their adoption has dropped from 89% to 76%.
Steady dominance? Yes. But competitors are catching up faster than… pic.twitter.com/jkCsxaUcnn
Anthropic: Fastest Growing Provider of 2024
— Portkey (@PortkeyAI) December 12, 2024
• 61% monthly growth in requests
• 22% monthly growth in organizations
Anthropic has been on fire. Every time they launch a new Claude model (like Sonnet 3.5, Haiku-3.5), we see big adoption spikes: model releases matter.
Anthropic… pic.twitter.com/KMsLLOLTsy
Gemini (Google): Late Start, Big Momentum
— Portkey (@PortkeyAI) December 12, 2024
49% monthly growth in requests
9% growth in new organizations
Gemini may have been late to the game, but they’re showing deep usage from those who’ve adopted them.
It’s a strong comeback for a Google—Let’s see how Gemini shapes up in… pic.twitter.com/8DYZReRjar
Cloud Providers: Partnerships Are Key
— Portkey (@PortkeyAI) December 12, 2024
Azure is leading the charge, with 3x more penetration than AWS Bedrock.
But here’s the twist:
Bedrock started the year with 10x the adoption of Vertex AI, but by year-end, it’s only 2x ahead.
It’s clear now: your AI infrastructure is as… pic.twitter.com/XcKMK2Delt
Amazon Bedrock: Fewer Orgs, Deeper Usage
— Portkey (@PortkeyAI) December 12, 2024
13% monthly growth in organizations
91% growth in requests
Bedrock isn’t catching up to OpenAI in reach, but when companies use it, they go all in.
High usage, fewer orgs—it’s all about depth here. pic.twitter.com/cH1TInSoJ7
Vertex AI: Building Momentum Fast
— Portkey (@PortkeyAI) December 12, 2024
43% monthly growth in requests
Vertex AI might’ve started slower, but it’s picking up steam. It’s catching up, just not there yet. pic.twitter.com/ogKPZ47yhl
Multi-Provider Usage Is on the Rise
— Portkey (@PortkeyAI) December 12, 2024
In just 10 months, the proportion of Portkey orgs using multiple providers jumped from 23% to 40%.
Why’s this happening?
Redundancy is cheap. Downtime isn’t.
After a year of outages and capacity issues, companies are finally realizing: you… pic.twitter.com/kGC8T3uVQV
Tomorrow: We’ll dive into how these providers actually perform in production. Spoiler alert: the numbers might surprise you. 😉
— Portkey (@PortkeyAI) December 12, 2024
Stay tuned, and follow @PortkeyAI for more insights from LLMs in Prod '24.
Find the next post in the series on Portkey's Twitter