Area | Key Updates |
---|---|
Platform | • See multi-workspace analytics & logs on a single dashboard • Support for Realtime API across OpenAI and Azure OpenAI • More granular security & access control settings • Organize your prompts in folders |
Integrations | • Route to AWS Sagemaker models through Portkey • Support for xAI provider and Llama 3.3 & Gemini 2.0 Flash models • New strictOpenAiCompliance flag on the Gateway |
Enterprise | • Support for AWS STS with IMDS/IRSA auth • Support for Azure Entra (formerly Active Directory) to manage Azure auth • Set budget limits with periodic resets • Support for any S3-compatible store for logging |
Community | • Won NetApp’s Best Growth Strategy Award • Hosted first Practitioners Dinner in Singapore • Weekly AI Engineering Office Hours |
Akshay Darbari, Director of Platform Engineering at Premera Blue Cross
staging
, production
to any prompt version to track changes, and call them directly:deploymentConfig
while making Virtual Keys through API. Docs“Now that we’ve seen positive results, we’re going to move all our prompts to Portkey.”
Structured Outputs
) feature on Vertex AI is now supported!