Observability - Modern monitoring for LLMs

Gain real-time insights, track key metrics, and streamline debugging with our comprehensive observability suite.

If you're working with an LLM - visibility across all your requests can be a BIG pain. How do you measure cost, latency, accuracy of your requests?

Portkey's observability features provide complete control over all your requests and Portkey's analytics dashboards provide the insights you're looking for. Fast.

Features

Logs

Portkey records all your multimodal requests and responses, making it easy to view, monitor and debug interactions.

Analytics

A comprehensive view of 21+ key metrics. Use it to analyse data, spot trends and make informed decisions.

Tracing

Portkey supports request tracing to help you monitor your applications throughout the lifecycle of a request.

Filters

Streamline your data view with customizable filters. Zero in on data that matters most.

Custom Metadata

Enrich your LLM APIs with custom metadata. Assign unique tags for swift grouping and troubleshooting.

Feedback

Add feedback values and weights to complete the loop

Budget Limits

Set up budget limits for your provider API keys and get confidence over your application's costs.