Bring Your Agents to Production with Portkey Portkey now natively integrates with Langchain, CrewAI, Autogen and other major agent frameworks, and makes your agent workflows production-ready.
Open Sourcing Guardrails on the Gateway Framework We are solving the *biggest missing component* in taking AI apps to prod → Now, enforce LLM behavior and route requests with precision, in one go.
Portkey & Patronus - Bringing Responsible LLMs in Production Patronus AI's suite of evaluators are now available on the Portkey Gateway.
LLMs in Prod Comes to Bangalore Portkey's LLMs in Prod series hit Bangalore, bringing together AI practitioners to tackle real-world challenges in productionizing AI apps. From AI gateways to agentic workflows to DSPy at scale, here's what's shaping the future of AI in production.
Partnering with F5 to Productionize Enterprise AI We are thrilled to announce that Portkey is partnering with F5, the creators of NGINX and global leader in multi-cloud application security & delivery, to bring enterprise AI apps to production. By integrating our AI Gateway and Observability Suite with F5 Distributed Cloud Services, we are accelerating the path to production
Anyscale's OSS Models + Portkey's Ops Stack The landscape of AI development is rapidly evolving, and open-source Large Language Models (LLMs) have emerged as a key foundation for building AI applications. Anyscale has been a game-changer here with their fast and cheap APIs for Llama2, Mistral, and more OSS models. But to harness the full potential of
GPT-4 is Getting Faster 🐇 Over the past few months, we've been keenly observing latencies for both GPT 3.5 & 4. The emerging patterns have been intriguing. The standout observation? GPT-4 is catching up in speed, closing the latency gap with GPT 3.5. Our findings reveal a consistent decline in GPT-4 latency. While your