> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Features

> Explore the powerful features of Prisma AIRS AI Gateway

## AI Gateway

Connect to 3,000+ AI models using a single consistent API. Set up load balancers, automated fallbacks, caching, conditional routing, and more, seamlessly.

<CardGroup cols={3}>
  <Card title="🌐 Universal API" href="/docs/aigw/product/ai-gateway/universal-api">
    Integrate with multiple AI models through a single API
  </Card>

  <Card title="💾 Caching" href="/docs/aigw/product/ai-gateway/cache-simple-and-semantic">
    Implement simple and semantic caching for improved performance
  </Card>

  <Card title="🔄 Fallbacks" href="/docs/aigw/product/ai-gateway/fallbacks">
    Set up automated fallbacks for enhanced reliability
  </Card>

  <Card title="🔀 Multimodal Capabilities" href="/docs/aigw/product/ai-gateway/multimodal-capabilities">
    Handle various data types with multimodal AI capabilities
  </Card>

  <Card title="🔁 Automatic Retries" href="/docs/aigw/product/ai-gateway/automatic-retries">
    Implement automatic retries for improved resilience
  </Card>

  <Card title="🔌 Circuit Breaker" href="/docs/aigw/product/ai-gateway/circuit-breaker">
    Configure per-strategy circuit protection and failure handling
  </Card>

  <Card title="⚖️ Load Balancing" href="/docs/aigw/product/ai-gateway/load-balancing">
    Distribute workload efficiently across multiple models
  </Card>

  <Card title="🔑 Integrations" href="/docs/product/integrations">
    Manage access to LLMs
  </Card>

  <Card title="⏱️ Request Timeouts" href="/docs/aigw/product/ai-gateway/request-timeouts">
    Set and manage request timeouts
  </Card>

  <Card title="🐤 Canary Tests" href="/docs/aigw/product/ai-gateway/canary-testing">
    Implement canary testing for safe deployments
  </Card>

  <Card title="🚦 Conditional Routing" href="/docs/aigw/product/ai-gateway/conditional-routing">
    Route requests based on specific conditions
  </Card>

  <Card title="💳 Budget Limits" href="/docs/aigw/product/policies/budget-limits">
    Set monthly or custom budget limits on LLM usage, at provider or API key level
  </Card>

  <Card title="⏳ Rate Limits" href="/docs/aigw/product/policies/rate-limits">
    Programmatically set rate limits at API key level and prevent abuse
  </Card>
</CardGroup>

## Observability & Logs

Gain real-time insights, track key metrics, and streamline debugging with our OpenTelemetry-compliant system.

<CardGroup cols={3}>
  <Card title="📜 Logs" href="/docs/aigw/product/observability/logs">
    Access and analyze detailed logs
  </Card>

  <Card title="🕵️ Tracing" href="/docs/aigw/product/observability/traces">
    Implement distributed tracing for request flows
  </Card>

  <Card title="📊 Analytics" href="/docs/aigw/product/observability/analytics">
    Gain insights through comprehensive analytics
  </Card>

  <Card title="🧪 Filters" href="/docs/aigw/product/observability/filters">
    Apply filters for targeted analysis
  </Card>

  <Card title="🏷️ Metadata" href="/docs/aigw/product/observability/metadata">
    Manage and utilize metadata effectively
  </Card>

  <Card title="💬 Feedback" href="/docs/aigw/product/observability/feedback">
    Collect and analyze user feedback
  </Card>
</CardGroup>

## Guardrails

Enforce Real-Time LLM Behavior with 50+ state-of-the-art AI guardrails, so that you can synchronously run Guardrails on your requests and route them with precision.

<CardGroup cols={2}>
  <Card title="🛡️ Deterministic Guardrails" href="/docs/aigw/product/guardrails/list-of-guardrail-checks">
    Implement rule-based safety checks
  </Card>

  <Card title="🤖 LLM-based Guardrails" href="/docs/aigw/product/guardrails/list-of-guardrail-checks">
    Leverage AI for advanced content filtering
  </Card>

  <Card title="🤝 Partner Guardrails" href="/docs/aigw/product/guardrails/list-of-guardrail-checks">
    Integrate third-party safety solutions
  </Card>

  <Card title="🎒 Bring Your Own" href="/docs/aigw/integrations/guardrails/bring-your-own-guardrails">
    Customize guardrails to your needs
  </Card>

  <Card title="🏛️ Central Guardrails" href="/docs/aigw/product/administration/enforce-organisation-level-guardrails">
    Deploy org-wide guardrails like PII redaction and company policy adherence across *all* AI calls
  </Card>
</CardGroup>

## Agents

Natively integrate the AI Gateway's routing, guardrails, and observability suite with leading agent frameworks and take them to production.

<CardGroup cols={3}>
  <Card title="🤖 Autogen" href="/docs/aigw/integrations/agents/autogen" />

  <Card title="👥 CrewAI" href="/docs/aigw/integrations/agents/crewai" />

  <Card title="🔗 Langchain Agents" href="/docs/aigw/integrations/agents/langchain-agents" />

  <Card title="🦙 Llama Agents" href="/docs/aigw/integrations/agents/llama-agents" />

  <Card title="φ PhiData" href="/docs/aigw/integrations/agents/phidata" />

  <Card title="🔀 ControlFlow" href="/docs/aigw/integrations/agents/control-flow" />

  <Card title="🕸️ LangGraph" href="/docs/aigw/integrations/agents/langgraph" />
</CardGroup>

## Governance & Administration

Organise your teams and entities with the access control, encryption, and audit trails that an enterprise AI platform needs.

<CardGroup cols={3}>
  <Card title="📁 Org Management" href="/docs/aigw/product/enterprise-offering/org-management">
    Organise your teams and entities with more access control in the AI Gateway
  </Card>

  <Card title="🔒 SSO Integrations" href="/docs/aigw/product/enterprise-offering/org-management/sso">
    Seamless integrations with your preferred Single Sign-On providers like Okta and Microsoft
  </Card>

  <Card title="👤 Access Rules" href="/docs/aigw/product/enterprise-offering/access-control-management">
    Team and individual level RBAC for AI services, LLMs, logs, and more
  </Card>

  <Card title="🗂️ Audit Logs" href="/docs/aigw/product/enterprise-offering/audit-logs">
    System-wide audit trails for all AI services and all the AI Gateway features described above
  </Card>

  <Card title="🔑 KMS Integration" href="/docs/aigw/product/enterprise-offering/kms">
    Bring your own encryption keys to the AI Gateway to encrypt data at rest
  </Card>

  <Card title="🗄️ Data Isolation" href="/docs/aigw/self-hosting/hybrid-deployments/architecture">
    Ensure the highest level of data privacy and security with isolated storage infrastructure
  </Card>

  <Card title="📅 Custom Retention Periods" href="/docs/aigw/product/administration/configuring-request-logging">
    Set custom retention periods for different users to meet your data storage requirements
  </Card>

  <Card title="❄️ Export to Data Lakes" href="/docs/aigw/product/observability/logs-export">
    Easily export all your data to your preferred data lake for long-term storage
  </Card>

  <Card title="📝 Executive Reporting" href="/docs/aigw/product/observability/analytics">
    Executive-only dashboards to track AI adoption, ROI, and strategic impact across your organisation
  </Card>
</CardGroup>

## More Resources

<CardGroup cols={2}>
  <Card title="💬 Developer Forum" href="/docs/support/developer-forum">
    Join our community of developers
  </Card>

  <Card title="📚 API Reference" href="/docs/aigw/api-reference/inference-api/introduction">
    Explore our comprehensive API documentation
  </Card>
</CardGroup>


## Related topics

- [Beta Features](/docs/aigw/product/ai-gateway/beta-features.md)
- [Anthropic](/docs/aigw/integrations/llms/anthropic.md)
- [Open Responses](/docs/aigw/product/ai-gateway/responses-api.md)
- [Conditional Routing](/docs/aigw/product/ai-gateway/conditional-routing.md)
- [BytePlus ModelArk](/docs/aigw/integrations/llms/byteplus.md)
