July
It’s been a landmark month.
Portkey is now the ✨official AI Gateway provider for Internet2 NET+✨, the gold standard for infrastructure across 300+ top U.S. universities including NYU, Harvard, Princeton, Cornell, and Berkeley. We’re now listed alongside AWS, Microsoft, and Google and we’re the youngest infra provider ever to make the cut!
Alongside this, we shipped major updates across the stack: expanded data residency support, enhanced logging and cost tracking for Claude Code, new providers and models, and more.
Let’s get into it!
NYU and Princeton leaders join us this Thursday, AUG 7 AT 1 P.M. ET to go behind the scenes of how GenAI is being deployed on campus. Register here
Summary
| Area | Key Highlights |
|---|---|
| Platform | • Regional data residency controls • Privacy mode • Automatic user attribution for user keys • Request transformations (original + final) • Log exports via UI, API, stream, webhook |
| Gateway & Providers | • New models: Grok-4, Qwen3-Coder, Kimi K2 • New providers: Krutrim, Agno AI • /v1/messages (beta): tool use, multi-turn, redacted thoughts • Custom models & pricing |
| Guardrails | • Palo Alto Networks AIRS plugin for real-time security guardrails • CRUD guardrails endpoint |
| Integrations | • LangSmith integration • AWS Bedrock Knowledge Bases • Langflow compatibility • Enhanced Claude Code logging & cost tracking |
Internet2 🤝 Portkey
Many universities face similar challenges when adopting GenAI: fragmented provider access, budgetary uncertainty, and regulatory pressure. Portkey helps address these by sitting between institutional systems and model providers by offering a single API with granular usage controls, analytics, and guardrails. “The Internet2 NET+ Service Evaluation process for Portkey has been a demonstration of collaboration and efficiency,” said Stratos Efstathiadis, Senior Director of Research Technology Services at NYU. “The synergy among peer institutions ensures Portkey meets the diverse AI requirements of higher education.” 📅 Join the NET+ Portkey Launch WebinarPlatform
Regional data residency All your LLM data can now be hosted in any region of your choice with strict isolation, no cross-border data flow, and full compliance with residency regulations.- Meet institutional and regional privacy mandates
- Improve latency by routing traffic through nearby zones
_user metadata, with an option to override.
Guardrails
Palo Alto Networks’ AIRS PluginGateway
Support for messages route(beta) In addition tochat.completions, Portkey now supports the messages route (beta) for Anthropic, AWS Bedrock, and Vertex AI. This includes tool calling, thinking, multi-turn conversations, and redacted thinking support
New models and providers
- Krutrim: LLM provider with regional language support
- Grok 4: The latest release from xAI’s Grok family, now supported on Portkey.
- Qwen3-Coder: Alibaba’s open-weight code model, available for direct use.
- Kimi K2: Moonshot’s new long-context model is now in production.
Integrations
Claude Code
Get cost tracking and usage breakdowns across teams for Claude Code generations — along with full request logs and output analysis to manage spend and performance.
AWS Bedrock Knowledge Bases
You can now connect to Bedrock Knowledge Bases directly through Portkey, with unified auth, caching, and logging across your RAG workflows.
Agno AI
Agno AI – Agno is a powerful framework for building autonomous agents, now supercharged with Portkey’s production-grade observability, governance, and tooling.
LangSmith
You can now export traces to LangSmith alongside Portkey’s built-in observability, for teams already using it for debugging or evals.
Langflow
Portkey now works natively with Langflow. Route all your workflows through Portkey to apply guardrails, monitor requests, and manage access without leaving your visual interface.
Resources
- Cookbook: Arize + Portkey: Multi-LLM debate with traces and evals
- Blog: How to add enterprise controls to OpenWebUI
- Blog: Everything We Know About Claude Code Limits