> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# May

**May-king it production ready✨**

In May, we shipped the kind of upgrades that help you move your AI Agents fast into productiion and stay in control — whether you're scaling, securing AI behavior, or bringing new models to your apps.

We launched deep integrations with agent frameworks like PydanticAI and OpenAI Agents SDK, added enterprise-grade controls to Claude Code, made it simpler to call a remote MCP server simpler and much more!

Here’s everything new this month:

## Summary

| Area             | Key Highlights                                                                                                                                                                                                                                                      |
| :--------------- | :------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| **Platform**     | • Full HTTP method support (`GET`, `PUT`, `DELETE`)<br />• OTel analytics export to your stack<br />• OpenAI Computer Use Tool support<br />• Multimodal embedding support (Vertex AI)                                                                              |
| **Enterprise**   | • Deep Azure AI ecosystem integration (Foundry, APIM, Marketplace)<br />• Claude Code with enterprise controls (rate limits, observability)<br />• Model whitelist guardrail for org/env control                                                                    |
| **Integrations** | • Expanded AI Agent Frameworks (PydanticAI, OpenAI SDK, Strands)<br />• Support for latest models (Claude 4, Grok 3, Gemini 2.5) & new providers<br />• AI Coding Assistant integrations (Cline, Roo Code)<br />• Remote MCP server & Arize Phoenix tracing support |
| **Security**     | • New Prompt Security guardrails (injection, data protection)<br />• JWT validator input guardrail<br />• PANW Prisma AIRS plugin for real-time risk blocking                                                                                                       |
| **Resources**    | • New Solution Pages (AWS Bedrock, GovCloud)<br />• New Cookbooks (OpenAI Computer Use, Llama Prompt Ops)                                                                                                                                                           |

***

## AI Agent Infrastructure

AI agent frameworks are helping teams prototype faster, but taking agents to production requires real infrastructure. Portkey integrates with leading frameworks to bring interoperability, observability, reliability, and cost management to your agent workflows.

<CardGroup cols={3}>
  <Card title="PydanticAI" href="https://portkey.ai/docs/integrations/agents/pydantic-ai#pydantic-ai">
    PydanticAI is a Python framework that brings FastAPI-like ergonomics to building AI agents.<br /><br />
  </Card>

  <Card title="OpenAI Agents SDK" href="https://portkey.ai/docs/integrations/agents/openai-agents">
    OpenAI Agents SDK helps teams ship production-grade agents with built-in planning, memory, and tool use.<br /><br />
  </Card>

  <Card title="Strands Agents" href="https://portkey.ai/docs/integrations/agents/strands">
    Strands Agents is a lightweight agent framework built by AWS to simplify agent development.<br /><br />

    <br />
  </Card>
</CardGroup>

**Tracing Integrations: Arize AI**

For teams consolidating observability into Arize, you can now view Portkey’s logs directly into Arize Phoenix to get unified trace views across your LLM workflows.

## Remote MCP servers

Portkey now supports calling a remote MCP server that is maintained by developers and organizations across the internet that expose these tools to MCP clients via the Responses API
Read more about the integration [here](https://portkey.ai/docs/product/ai-gateway/remote-mcp).

## Azure AI ecosystem

More than half of Fortune 500 companies use Azure OpenAI. But building GenAI apps in the enterprise is still messy, cost attribution, routing logic, usage tracking, model evaluation... all scattered.

<Frame>
  <img width="700" src="https://mintcdn.com/portkey-docs/Hf1XgyjG_b79ym4Q/images/changelog/azure-integration.jpeg?fit=max&auto=format&n=Hf1XgyjG_b79ym4Q&q=85&s=d7a1f26318c20d043ce882c002f2cf28" data-path="images/changelog/azure-integration.jpeg" />
</Frame>

With Portkey’s deep integration into the Azure AI ecosystem (OpenAI, Foundry, APIM, Marketplace), teams can now build, scale, and govern GenAI apps without leaving their existing cloud setup.

Our customers are vouching for it!

<Frame>
  <img width="700" src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/testimonial3.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=0fb24884dbaa5a6022bea6fa92585999" data-path="images/changelog/testimonial3.png" />
</Frame>

## Portkey for AI Tools

<CardGroup cols={2}>
  <Card title="Claude Code" href="https://portkey.ai/docs/integrations/libraries/claude-code">
    Bring enterprise-grade visibility, governance, and access control to Claude Code.
  </Card>

  <Card title="Cline" href="https://portkey.ai/docs/integrations/libraries/cline">
    Supercharge your AI-powered terminal with cost tracking, access controls, and observability.
  </Card>

  <Card title="Roo Code" href="https://portkey.ai/docs/integrations/libraries/roo-code">
    Add security, compliance, and real-time analytics to your code assistant workflows.
  </Card>

  <Card title="Goose" href="https://portkey.ai/docs/integrations/libraries/goose">
    Add essential enterprise controls to Goose's powerful autonomous coding capabilities
  </Card>
</CardGroup>

## Multilmodal embeddings

Portkey now supports embedding APIs from Vertex AI for text, image, and video—across multiple languages.
This unlocks the ability to:

* Build multimodal search and retrieval
* Power multimodal RAG pipelines
* Track, route, and optimize embedding usage at scale

Read more about the implementation [here](https://portkey.ai/docs/integrations/llms/vertex-ai/embeddings)

## Platform

**Multi-label support for prompts**

<Frame>
  <img width="700" src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/multi-label%20prompts.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=7b037c1a4005219fb0b24eba627d463a" data-path="images/changelog/multi-label prompts.png" />
</Frame>

You can now assign multiple labels to a single prompt version, making it easy to promote a version across environments like staging and production.

**Gateway to any API**

Portkey now supports `GET`, `PUT`, and `DELETE` HTTP methods in addition to `POST`, allowing you to route requests to any external or self-hosted provider endpoint. This means you can connect to custom APIs directly through Portkey with full observability for every call.

**OTel Integration (Analytics Data)**

You can now export Portkey analytics to any OpenTelemetry (OTel)-compatible collector, integrating easily into your existing observability stack.

**Improvements**

* Token cost tracking is now available for `gpt-image-1`.
* Ping messages are removed from streamed responses.
* Resizing metadata columns in logs

**This is what keeps us going!**

<Frame>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/testimonial1.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=42b4d2b8ce45cc69a0a447e91097b7b8" width="100%" data-path="images/changelog/testimonial1.png" />
</Frame>

## New Models & Providers

<div style={{ display: "flex", gap: "2rem", flexWrap: "wrap" }}>
  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <b>New additions</b>
      <li><b>Claude 4</b> is now live for advanced reasoning and coding.</li>
      <li><b>Grok 3 & Grok 3 Mini</b> are available on Azure</li>
      <li><b>Lepton AI</b> is now live</li>
      <li><b>Nscale Models</b> can now be accessed through Portkey.</li>
    </ul>
  </div>

  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <b>Updates</b>
      <li><b>PDF Support for Claude</b> via Anthropic and Bedrock.</li>
      <li><b>Gemini 2.5 Thinking Mode</b> is now supported in Prompt Playground.</li>
      <li><b>Extended Thinking</b> is available for Claude 3.7 and Claude 4.</li>
      <li>Image generation now supported on WorkersAI</li>
      <li><b>Tool Calling and Function Calling for Mistral</b> is now live.</li>
      <li><b>MIME Type</b> is now supported for Vertex AI</li>
    </ul>
  </div>
</div>

## Guardrails

* **Prompt Security guardrails**: Integrate with Prompt Security to detect prompt injection and prevent sensitive data exposure in both prompts and responses.

* **JWT validator guardrail**: Added as an input guardrail to validate incoming JWT tokens before requests are sent to the LLM.

* **PANW Prisma AIRS Plugin**: Portkey now integrates with Palo Alto Networks' AIRS (AI Runtime Security) to enforce guardrails that block risky prompts or model responses based on real-time security analysis.

* **Model whitelist guardrail**: Restrict or deny specific models at the org, environment, or request level using a flexible whitelist/blacklist guardrail.

**No frills. No hype. Just serious safety**

<Frame>
  <img src="https://mintcdn.com/portkey-docs/QFjngWBmb6CT7QXC/images/changelog/lions-teat.png?fit=max&auto=format&n=QFjngWBmb6CT7QXC&q=85&s=02b23aca5988965d435d2333eaab6b42" width="100%" data-path="images/changelog/lions-teat.png" />
</Frame>

## Resources

* Cookbook: [Optimizing Prompts with LLama Prompt Ops](https://portkey.ai/docs/guides/prompts/llama-prompts)
* Cookbook: [OpenAI Computer Use Tool](https://portkey.ai/docs/guides/use-cases/openai-computer-use)
* Guardrail documentation is now located under “Integrations”.
* Expanded guides for agent frameworks, including CrewAI and LangGraph.

## Community Contributors

A special thanks to our community contributors this month:

* [unsync](https://github.com/unsync)
* [tomukmatthews](https://github.com/tomukmatthews)
* [jroberts2600](https://github.com/jroberts2600)

## Coming this month!

Provision and manage LLM access across your entire org from a single admin panel. Centralized controls. Granular permissions. Stay tuned.

## Support

<CardGroup cols={2}>
  <Card title="Need Help?" icon="bug" href="https://github.com/Portkey-AI/gateway/issues">
    Open an issue on GitHub
  </Card>

  <Card title="Join Us" icon="discord" href="https://portkey.wiki/community">
    Get support in our Discord
  </Card>
</CardGroup>
