> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# November

November was a month of momentum across customers, models, governance, and community.

Teams like Snorkel AI continue to push the boundaries of evaluation and training pipelines, running multi-agent systems that compare and verify outputs across models like Anthropic and Gemini. We’ve been learning a lot from how organizations like these operate at scale.

On the platform side, we expanded our provider landscape, shipped multiple model releases on Day 0, and worked on enhancing our guardrails and observability.

We’re closing the year with conversations and gatherings across the community! If you’re attending <b>AWS re:Invent</b> and want to meet the core team behind Portkey, grab a 1:1 slot [here](https://calendly.com/d/csjy-mr6-vfg/aws-re-invent).

## Summary

| Area                   | Key Highlights                                                                                                        |
| ---------------------- | --------------------------------------------------------------------------------------------------------------------- |
| **Models & Providers** | • GPT-5.1 <br />• Gemini 3.0<br />• Claude Opus 4.5 <br />• New providers: Z-AI, MatterAI, CometAPI, Modal Labs       |
| **Platform**           | • Conditioner Router now supports URL-based conditions<br />• Usage limits & rate-limit policies for org-wide control |
| **Observability**      | • Trace visibility by category<br />• Guardrail checks highlighted in logs<br />• OTel log export                     |
| **Guardrails**         | • F5 Guardrail added<br />• Javelin Guardrails added <br /> • Guardrails for streaming responses                      |

## How Snorkel AI runs multi-agents evals for frontier models

Snorkel AI has been doing some fascinating work around evaluating frontier models from Anthropic, Google, and others. Their team built a multi-agent evaluation system that plans, reasons, and verifies model outputs.

As the scale and complexity of these eval workloads increased, they needed a way to move beyond fragmented scripts and logs toward a single, reliable source of truth for debugging.

Read their [full breakdown](https://portkey.ai/blog/how-snorkel-evaluates-and-trains-top-ai-models) that includes architecture, evaluation flows, learnings, and infrastructure decisions.

<img src="https://mintcdn.com/portkey-docs/4y153rluO3wygj8A/images/changelog/snorkel-multi-agent-systems.png?fit=max&auto=format&n=4y153rluO3wygj8A&q=85&s=bad0449808bcbe6541d0bec1190ceb18" alt="industry-leader-testimonial" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="1686" height="958" data-path="images/changelog/snorkel-multi-agent-systems.png" />

## Platform

### Budget policies

You can now define usage budgets and throughput controls at an organization or team level, without configuring them individually using budget policies.
You can create usage limits and rate limit policies with conditions based on:

* API keys
* Metadata fields
* Workspaces
* Combined multi-condition rules

This makes governance far more scalable. See how you can set up usage limits and rate-limit policies [here](https://portkey.ai/docs/product/enterprise-offering/budget-policies).

### URL support in Conditional Router

You can match requests based on the request's URL path, increases the for routing and giving you granular control over model selection. Read more about this [here](https://portkey.ai/docs/product/ai-gateway/conditional-routing#url-path-routing).

<img src="https://mintcdn.com/portkey-docs/dNqEt4ISkjENXBa2/images/changelog/url-path.png?fit=max&auto=format&n=dNqEt4ISkjENXBa2&q=85&s=f24f09aedbd58d59f31bd4a06379119c" alt="url-path-conditional-router" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="3312" height="2433" data-path="images/changelog/url-path.png" />

## From the who's who in the industry!

<img src="https://mintcdn.com/portkey-docs/4y153rluO3wygj8A/images/changelog/industry-leader-testimonial.png?fit=max&auto=format&n=4y153rluO3wygj8A&q=85&s=e0a0c8f41e357a418e3fc2d04fdeceec" alt="industry-leader-testimonial" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="2200" height="896" data-path="images/changelog/industry-leader-testimonial.png" />

## Observability

### Improved trace visibility

You can now see traces by category, making it easier to understand whether traffic originated from chat, batch, routing, agent calls, or system functions.

<img src="https://mintcdn.com/portkey-docs/dNqEt4ISkjENXBa2/images/changelog/traces-category.png?fit=max&auto=format&n=dNqEt4ISkjENXBa2&q=85&s=80a0ebca1e9f8b584ab17909d0dc136c" alt="trace-category" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="2400" height="1788" data-path="images/changelog/traces-category.png" />

### Detailed guardrail checks in logs

See guardrail-flagged events more prominently in logs, simplifying debugging of blocked, redacted, or policy-violating requests.

<img src="https://mintcdn.com/portkey-docs/4y153rluO3wygj8A/images/changelog/guardrails-logs.png?fit=max&auto=format&n=4y153rluO3wygj8A&q=85&s=c1531e1aa02eba8958b2636679aa3d57" alt="guardrails-checks-in-logs" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="2200" height="1200" data-path="images/changelog/guardrails-logs.png" />

### OTel Log Export \[Experimental]

You can now export Gateway logs to an OpenTelemetry-compatible endpoint, aligned to experimental GenAI semantic conventions, allowing external systems to ingest AI activity traces. Read more about this [here](https://portkey.ai/docs/product/observability/opentelemetry#experimental-features).

## Guardrails

### F5 Guardrail

You can now configure **F5 Guardrails**, expanding Portkey’s guardrails ecosystem for runtime moderation, safety filtering, and structured response control.

This enables additional security layers for production workloads and is especially useful when running automated agent pipelines or public-facing interfaces. See how you can implement F5 Guardrails [here](https://portkey.ai/docs/integrations/guardrails/f5-guardrails).

### Qualifire Guardrails

Qualifire offers a comprehensive suite of **AI safety and quality guardrails** designed to keep applications compliant, safe, and high-integrity in production.

Their platform provides **20+ guardrail checks** spanning content risk, output validation, and policy compliance. See how you can implement Qualifire Guardrails [here](https://portkey.ai/docs/integrations/guardrails/qualifire).

### Guardrails in streaming responses

Streaming endpoints (`/chat/completions`, `/completions`, `/embeddings`, `/messages`) can now return guardrail evaluation results in real time.

This helps you to:

* Stop streaming mid-response
* Mask or redact content dynamically
* Enforce content policy on UI without waiting for the full generation

## Customer Love!

<img src="https://mintcdn.com/portkey-docs/dNqEt4ISkjENXBa2/images/changelog/snorkel-testimonial.png?fit=max&auto=format&n=dNqEt4ISkjENXBa2&q=85&s=866012c4ae332f242a509288e2358720" alt="snorkel-testimonial" style={{maxWidth: "80%", borderRadius: "8px", margin: "24px 0"}} width="3272" height="1309" data-path="images/changelog/snorkel-testimonial.png" />

## Gateway

### New models & providers

<div style={{ display: "flex", gap: "2rem", flexWrap: "wrap" }}>
  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <li><b>GPT-5.1</b>: Frontier-grade model now available.</li>
      <li><b>Gemini 3.0</b>: Google’s latest model with improved reasoning performance.</li>
      <li><b>Claude Opus 4.5</b>: Anthropic’s strongest reasoning model.</li>
    </ul>
  </div>

  <div style={{ flex: 1, minWidth: 300 }}>
    <ul>
      <li><b>MatterAI</b>: Reasoning-focused LLM provider with models Axon, Axon Mini, Axon Code.</li>
      <li><b>Z-AI</b>: Multiple model families with flexible deployment for experimentation, inference, and evaluation</li>
      <li><b>CometAPI</b>: Enabling high-concurrency access to hundreds of models through a single endpoint.</li>
      <li><b>Modal Labs</b>: A high-performance serverless platform for model hosting and inference execution.</li>
    </ul>
  </div>
</div>

### Model & Provider Enhancements

<ul>
  <li>Vertex AI: Added support for Computer Use and `anthropic-beta`</li>
  <li>OpenAI: Added support for `conversation` & `modalities` parameters and pricing for Sora models.</li>
  <li>Azure OpenAI: Added support for `model-router`and pricing for Sora models. </li>
  <li>Azure Foundry: Added support for Anthropic models</li>
  <li>Pricing for gemini-2.5-flash-image, gemini-3-pro-image-preview, Veo and Together AI's image models</li>
  <li>Pricing for fine-tuning operations across OpenAI, Azure OpenAI, and Vertex AI</li>
</ul>

## Community & Events

### Meet us in person at AWS re:Invent!

We’re at **AWS re:Invent**! If you'd like to meet the founders, discuss platform strategy, or just meet for ☕️ ,grab a 1:1 slot [here](https://calendly.com/d/csjy-mr6-vfg/aws-re-invent).

### 3000 Tokens/Sec - Building a high throughput LLM inference engine

We're hosting a joint session with **Cerebras** on running high-throughput inference
(\~3,000 tokens/sec+) in production.

📅 9th December: Join us [live](https://luma.com/dzzf3iq8)

### Private Dinner with AI & Tech Leaders (San Francisco)

We're hosting a **private dinner in San Francisco on 8th December, Monday** for AI infra
leaders, CTOs, and platform engineers. Expect deep product conversations, real scaling stories, and strong networking energy.

Seats are limited, [request an invite](https://luma.com/pa4azaix).

### Private Dinner for Higher Education and Research (Denver)

We're also hosting a closed-room **education-focused leadership dinner at Denver
on 10th December, Wednesday**. We'll be discussing the unique challenges of adopting AI in research and higher-ed settings, including compliance, data privacy, and infrastructure needs.

🎓 Ideal for CIOs and higher-ed AI program leads. [Request an invite](https://luma.com/2efn9ias)

## Resources

* **Blog**: [From standard to ecosystem: the new MCP updates](https://portkey.ai/blog/new-mcp-updates)
* **Blog**: [AI tool sprawl: causes, risks, and how teams can regain control](https://portkey.ai/blog/ai-tool-sprawl-causes-risks-and-how-teams-can-regain-control)
* **Blog**: [The complete guide to LLM observability for 2026](https://portkey.ai/blog/the-complete-guide-to-llm-observability)
* **Blog**: [AI cost observability: A practical guide to understanding and managing LLM spend](https://portkey.ai/blog/ai-cost-observability-a-practical-guide-to-understanding-and-managing-llm-spend)

## Community Contributors

A special thanks to our contributors this month:[jroberts2600](https://github.com/jroberts2600) and [drorIvry](https://github.com/drorIvry).

## Support

<CardGroup cols={2}>
  <Card title="Need Help?" icon="bug" href="https://github.com/Portkey-AI/gateway/issues">
    Open an issue on GitHub
  </Card>

  <Card title="Join Us" icon="discord" href="https://portkey.wiki/community">
    Get support in our Discord
  </Card>
</CardGroup>