What is shadow AI, and why is it a real risk for LLM apps Unapproved LLM usage, unmanaged APIs, and prompt sprawl are all signs of shadow AI. This blog breaks down the risks and how to detect it in your GenAI stack.
August at Portkey: 2 BILLION Requests, Guardrails, Tracing, and More Last month at Portkey, we crossed 2 BILLION total requests processed through our platform. To think, Portkey just started a year ago when this number was at 0! We're truly humbled to be production partners for some of the world's leading AI companies. And this drives us to continue innovating
Jamming on Event-Driven Architecture and MCP for Multi-Agentic Systems Insights from Portkey's AI Practitioners Meetup on building scalable multi-agent systems. Learn about Event-Driven Architecture patterns, Model Context Protocol implementation, and real-world experiences building multi-agents system.
Beyond the Hype: The Enterprise AI Blueprint You Need Now (And Why Your AI Gateway is Non-Negotiable) The Gen AI wave isn't just approaching—it's already crashed over every industry, leaving enterprises to navigate the aftermath. As a CTO or CIO, you've moved past the demos and proofs-of-concept. The questions keeping you up at night are now existential: How do we operationalize this technology at scale? How
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference - Summary