August

August was all about real-world impact and community. Princeton and NYU shared how they’re deploying Portkey across their institutions. Seeing our platform in action at these universities was incredible. Future of AI Platforms brought together industry leaders from Doordash, Postman, Qure.ai and more for honest conversations about challenges and opportunities. Meanwhile, we shipped what you asked for: multiple workspace guardrails, OTEL instrumentation, and day-zero support for the latest models. Here’s what’s new this month:

​

Summary

Area	Key Highlights
Highlights	• Making GenAI rollout easy with Princeton, NYU and Internet2 • Upcoming Palo Alto Networks webinar • New /models endpoint
Platform	• Unified + Portkey batching • OTEL-based auto-instrumentation • Multiple guardrails at workspace level • CRUD Guardrails API
Gateway & Providers	• Featherless.ai integration • GPT-OSS models support • Claude Opus 4.1 support • Custom models and pricing

​

Highlights

​

Making GenAI rollout easy with Ivy League institutions and Internet2

Together with Internet2, we co-hosted a webinar where Ivy League institutions like NYU shared how universities are deploying GenAI across classrooms, research, and student services. The session highlighted how Portkey’s AI Gateway provides secure model access, guardrails, and compliance support for educational institutions. Watch the recording here →.

​

Protecting Your AI Platform - Palo Alto Networks x Portkey

Join us for an upcoming webinar in partnership with Palo Alto Networks where we’ll explore best practices for securing AI infrastructure at scale, implementing enterprise-grade guardrails, and maintaining compliance while enabling innovation. Click here to register.

​

Platform

​

List models API

You can now see a list of all models available through Portkey—along with basic details for each one. This makes it easier to discover which models you can use and compare providers and options. Read more about it here.

​

Unified + Portkey Batching

Optimize throughput and reduce costs with our improved batching capabilities. We’ve implemented unified batching across all supported providers with intelligent request grouping for optimized performance. This reduces per-request overhead while providing automatic batch size optimization and configurable parameters to suit your specific needs. See how you can get started here.

​

OTEL-based autoinstrumentation

Portkey now works as an OTel endpoint. Send telemetry from any OTel-compatible source into Portkey and view it alongside LLM call logs. End-to-end observability for performance, cost, and compliance. Super powerful for agent workflows. See how you can implement this here This strengthens our observability even further!

​

Multiple guardrails at the workspace level

You can now define and enforce multiple guardrail policies at the workspace-level, making it easier to secure usage, filter content, and maintain compliance across your team.

​

CRUD Guardrails API

Managing guardrails at scale just got easier. You can now create, update, retrieve, delete, and list guardrails directly via API. This makes it simple to keep policies consistent across environments, automate changes, and integrate guardrail management into your CI/CD workflows. Learn more.

​

New Models and Providers

• Featherless.ai: Access 11,900+ open-source models with unlimited tokens through a single gateway. Learn more →
• GPT-OSS Models: OpenAI’s new open-weight models with strong reasoning and tool use capabilities.
• Claude Opus 4.1: Anthropic’s latest flagship model with 74.5% performance on SWE-bench Verified.

​

🌐 Community Highlights

​

Future of AI Platforms

Leaders from DoorDash, Postman, Qure.ai, and Qoala joined us for the Future of AI Platforms. It turned into a night of sharp ideas, candid discussions, and bold visions for where AI is headed. Where should we host it next? 👉 Send us an email if you’d be interested in attending!

​

Enterprise Security with Falco Vanguard

Falco Vanguard is using Portkey’s AI infrastructure to build an innovative security platform that intelligently clusters security events and prioritizes critical threats. Their offline-first approach ensures data sovereignty while their integration with Portkey provides the reliability and production readiness enterprises demand. We’re excited to see how this collaboration transforms security operations for organizations. Read more about this here →.

​

Resources

• Blog: Simplifying LLM batch reference
• Blog: OTel traces with LLM logs for end-to-end observability agent workflows

​

Community Contributors

A special thanks to our contributor this month:

• pnkvalavala
• indranil-kar-cloudesign
• horochx

​

Coming this month!

Our MCP gateway is almost here! Reach out to us on [email protected] for early access!

​

Support