AI Gateway - Streamline LLM Integrations

Portkey provides the world's fastest AI gateway that enables working with multiple LLM providers easily. The gateway providers features to improve your apps reliability, cost efficiency and accuracy.

Features

Using the Gateway

The various gateway strategies are implemented using Gateway configs. You can read more about configs below.

Open Source

We've open sourced our battle-tested AI gateway to the community. You can run it locally with a single command:

npx @portkey-ai/gateway

Contribute here.

You can also self-host the gateway and then connect it to Portkey. Please reach out on [email protected] and we'll help you set this up!

Last updated