AI observability and debugging platform with OpenInference instrumentation and intelligent gateway routing
Arize Phoenix is an open-source AI observability platform designed to help developers debug, monitor, and evaluate LLM applications. Phoenix provides powerful visualization tools and uses OpenInference instrumentation to automatically capture detailed traces of your AI system’s behavior.
Phoenix’s OpenInference instrumentation combined with Portkey’s intelligent gateway provides comprehensive debugging capabilities with automatic trace collection, while adding routing optimization and resilience features to your LLM calls.
from openai import OpenAIfrom portkey_ai import createHeaders# Use Portkey's gateway for intelligent routingclient = OpenAI( api_key="YOUR_OPENAI_API_KEY", # Or use a dummy value with virtual keys base_url="https://api.portkey.ai/v1", default_headers=createHeaders( api_key="YOUR_PORTKEY_API_KEY", virtual_key="YOUR_VIRTUAL_KEY" # Optional: Use Portkey's secure key management ))
Control trace sampling for production environments:
Copy
Ask AI
from opentelemetry.sdk.trace.sampling import TraceIdRatioBased# Sample 10% of tracesregister( set_global_tracer_provider=False, sampler=TraceIdRatioBased(0.1))