- Test your data with different foundation models
- Perform A/B testing with different foundation models
- Perform batch inference with different foundation models
Portkey supports two modes on Azure OpenAI:
- Provider Batch API (cheapest, completion_window:
24h
,48h
, etc.) - Portkey Batch API (fast, provider-agnostic, completion_window:
immediate
)