fallback
mode.
Here’s a quick example of a config to fallback to Anthropic’s claude-3.5-sonnet
if OpenAI’s gpt-4o
fails.
on_status_codes
param in your fallback config and manually inputting the status codes on which fallback will be triggered.
429
error code from the OpenAI request (i.e. rate limiting error)
Config ID
where you’ve setup the fallback - this will show all the requests that have been sent with that config.Trace ID
- this will show all the logs originating from a single request.