> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# July

It’s been a landmark month.

Portkey is now the **✨official AI Gateway provider for Internet2 NET+✨**, the gold standard for infrastructure across 300+ top U.S. universities including NYU, Harvard, Princeton, Cornell, and Berkeley. We’re now listed alongside AWS, Microsoft, and Google and we’re the youngest infra provider ever to make the cut!

Alongside this, we shipped major updates across the stack: expanded data residency support, enhanced logging and cost tracking for Claude Code, new providers and models, and more.

Let’s get into it!

## Summary

| Area                    | Key Highlights                                                                                                                                                                                                      |
| :---------------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **Platform**            | • Regional data residency controls  <br /> • Privacy mode  <br /> • Automatic user attribution for user keys  <br /> • Request transformations (original + final) <br /> • Log exports via UI, API, stream, webhook |
| **Gateway & Providers** | • New models: Grok-4, Qwen3-Coder, Kimi K2  <br /> • New providers: Krutrim, Agno AI <br /> • /v1/messages (beta): tool use, multi-turn, redacted thoughts  <br /> • Custom models & pricing                        |
| **Guardrails**          | • Palo Alto Networks AIRS plugin for real-time security guardrails   <br /> • CRUD guardrails endpoint                                                                                                              |
| **Integrations**        | • LangSmith integration  <br /> • AWS Bedrock Knowledge Bases  <br /> • Langflow compatibility  <br /> • Enhanced Claude Code logging & cost tracking                                                               |

## Internet2 🤝 Portkey

Many universities face similar challenges when adopting GenAI: fragmented provider access, budgetary uncertainty, and regulatory pressure. Portkey helps address these by sitting between institutional systems and model providers by offering a single API with granular usage controls, analytics, and guardrails.

“The Internet2 NET+ Service Evaluation process for Portkey has been a demonstration of collaboration and efficiency,” said **Stratos Efstathiadis, Senior Director of Research Technology Services at NYU**. “The synergy among peer institutions ensures Portkey meets the diverse AI requirements of higher education.”

**📅 Join the NET+ Portkey Launch Webinar**

<Frame>
  <img src="https://media.licdn.com/dms/image/v2/D4D22AQGcz-ZLJ7_Okg/feedshare-shrink_2048_1536/B4DZhbuT7CGQAo-/0/1753885535159?e=1756944000&v=beta&t=1oC3_tr2AAJchDlpV9GTWqY0aOVhFka7p1TbnQLLlWs" alt="Portkey Webinar" width="100%" style={{ borderRadius: "12px" }} />
</Frame>

NYU and Princeton leaders join us this Thursday, AUG 7 AT 1 P.M. ET to go behind the scenes of how GenAI is being deployed on campus. [Register here](https://events.internet2.edu/ereg/index.php?eventid=850237)

## Platform

**Regional data residency**

All your LLM data can now be hosted in any region of your choice with strict isolation, no cross-border data flow, and full compliance with residency regulations.

* Meet institutional and regional privacy mandates

* Improve latency by routing traffic through nearby zones

**Log exports**

You can now export logs directly from the Portkey UI or through the API. Whether you're debugging, auditing, or building internal dashboards, you can export and access complete logs in a structured, reliable format.

**Transformed requests in logs**

<Frame>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/transformed-logs.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=f1a133c971a3ca1eed500d9019eb5c38" alt="transformed logs" width="100%" style={{ borderRadius: "12px" }} data-path="images/changelog/transformed-logs.png" />
</Frame>

Debugging just got simpler. You can now view the original request as received by Portkey, the transformed version sent to the model provider, and same for the response in logs, making it easier for debugging.

**Privacy mode (logging off)**

Portkey now gives org owners granular control over what gets logged, from full request/response payloads to just minimal metadata.

<Frame>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/privacy-mode.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=4b901b3922ff0168cc0ac62dcfe5314b" alt="transformed logs" width="100%" style={{ borderRadius: "12px" }} data-path="images/changelog/privacy-mode.png" />
</Frame>

This can be configured org-wide or per workspace, offering flexibility for sensitive or regulated use cases.[Configure it for your org](https://portkey.ai/docs/product/administration/configuring-request-logging).

**Automatic user attribution on API keys**

Every request made using a user API key now automatically carries `_user` metadata, with an option to override.

## Guardrails

**Palo Alto Networks’ AIRS Plugin**

<Frame>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/prisma-airs.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=f765018089e9b15dd22fec768c770592" alt="AIRS Plugin" width="100%" style={{ borderRadius: "12px" }} data-path="images/changelog/prisma-airs.png" />
</Frame>

Portkey now integrates with PANW AIRS (AI Runtime Security) to enforce guardrails that block risky prompts or model responses based on real-time security analysis. [Learn more](https://portkey.ai/docs/integrations/guardrails/palo-alto-panw-prisma)

**CRUD Guardrails endpoint**

We’ve added full support for managing guardrails via API — create, update, delete, and list guardrail rules and templates programmatically. [Learn more](https://portkey.ai/docs/api-reference/admin-api/control-plane/guardrails/create-guardrail)

## Gateway

**Support for messages route(beta)**

In addition to `chat.completions`, Portkey now supports the `messages` route (beta) for Anthropic, AWS Bedrock, and Vertex AI. This includes tool calling, thinking, multi-turn conversations, and redacted thinking support

## New models and providers

<div style={{ display: "flex", gap: "2rem", flexWrap: "wrap" }}>
  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <li><b>Krutrim</b>: LLM provider with regional language support.</li>
      <li><b>Grok 4</b>: The latest release from xAI’s Grok family, now supported on Portkey.</li>
    </ul>
  </div>

  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <li><b>Qwen3-Coder</b>: Alibaba’s open-weight code model, available for direct use.</li>
      <li><b>Kimi K2</b>: Moonshot’s new long-context model is now in production.</li>
    </ul>
  </div>
</div>

## Integrations

<CardGroup cols={2}>
  <Card title="Claude Code" icon="integration" href="https://portkey.ai/docs/integrations/libraries/claude-code">
    Get cost tracking and usage breakdowns across teams for Claude Code generations — along with full request logs and output analysis to manage spend and performance.
  </Card>

  <Card title="AWS Bedrock Knowledge Bases" icon="integration" href="https://portkey.ai/docs/integrations/llms/bedrock/bedrock-knowledgebase">
    You can now connect to Bedrock Knowledge Bases directly through Portkey, with unified auth, caching, and logging across your RAG workflows.
  </Card>

  <Card title="Agno AI" icon="integration" href="https://portkey.ai/docs/integrations/agents/agno-ai">
    Agno AI – Agno is a powerful framework for building autonomous agents, now supercharged with Portkey’s production-grade observability, governance, and tooling.
  </Card>

  <Card title="LangSmith" icon="integration" href="https://portkey.ai/docs/integrations/tracing-providers/langsmith">
    You can now export traces to LangSmith alongside Portkey’s built-in observability, for teams already using it for debugging or evals.
  </Card>

  <Card title="Langflow" icon="integration" href="https://portkey.ai/docs/integrations/libraries/langflow">
    Portkey now works natively with Langflow. Route all your workflows through Portkey to apply guardrails, monitor requests, and manage access without leaving your visual interface.
  </Card>
</CardGroup>

**Portkey + your fav AI tool = 🪄✨**

<Frame style={{ display: "flex", justifyContent: "flex-start" }}>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/tim-manik-librechat.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=90ba3d3cf0dd835e8ac6c4c98abdebae" width="100%" style={{ borderRadius: "12px", display: "block", marginLeft: 0 }} data-path="images/changelog/tim-manik-librechat.png" />
</Frame>

## Resources

* Cookbook: [Arize + Portkey: Multi-LLM debate with traces and evals](https://portkey.ai/docs/guides/integrations/arize-portkey)
* Blog: [How to add enterprise controls to OpenWebUI](https://portkey.ai/blog/how-to-add-enterprise-controls-to-openwebui)
* Blog: [Everything We Know About Claude Code Limits](https://portkey.ai/blog/claude-code-limits)

## Community Contributors

A special thanks to our contributor this month:

* [AG2AI-Admin](https://github.com/AG2AI-Admin)
* [Mishalabdullah](https://github.com/Mishalabdullah)

## Coming this month!

MCP Connectors on the gateway! Reach out to us on [support@portkey.ai](mailto:support@portkey.ai) for a sneakpeek!

## Support

<CardGroup cols={2}>
  <Card title="Need Help?" icon="bug" href="https://github.com/Portkey-AI/gateway/issues">
    Open an issue on GitHub
  </Card>

  <Card title="Join Us" icon="discord" href="https://portkey.wiki/community">
    Get support in our Discord
  </Card>
</CardGroup>