Replicate is a platform for building and running machine learning models. Replicate does not have a standarized JSON body format for their inference API, hence it is not possible to use unified API to interact with Replicate. Portkey instead provides a proxy to Replicate, allowing you to manage auth on Portkey and log all Replicate requests.

Portkey SDK Integration with Replicate

To integrate Replicate with Portkey:

1. Install the Portkey SDK

Add the Portkey SDK to your application to interact with Replicate through Portkey’s gateway.
npm install --save portkey-ai

2. Create a New Integration

To use Replicate with Portkey, get your Replicate API key from here, then add it to Portkey to create your Replicate virtual key.
import Portkey from 'portkey-ai'

const portkey = new Portkey({
    apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
    provider:"@PROVIDER" // Your Replicate Virtual Key
})

3. Use the Portkey SDK to interact with Replicate

from portkey_ai import Portkey

portkey = Portkey(
    api_key="PORTKEY_API_KEY",  # Replace with your Portkey API key
    provider="@REPLICATE_PROVIDER",
)

response = portkey.post(
    url="predictions", # Replace with the endpoint you want to call
)

print(response)