Replicate

Replicate is a platform for building and running machine learning models.

Replicate does not have a standarized JSON body format for their inference API, hence it is not possible to use unified API to interact with Replicate. Portkey instead provides a proxy to Replicate, allowing you to use virtual keys and observability features.

​

Portkey SDK Integration with Replicate

To integrate Replicate with Portkey:

​

1. Install the Portkey SDK

Add the Portkey SDK to your application to interact with Replicate through Portkey’s gateway.

• NodeJS
• Python

npm install --save portkey-ai

​

2. Initialize Portkey with a Virtual Key

To use Replicate with Portkey, get your Replicate API key from here, then add it to Portkey to create your Replicate virtual key.

• NodeJS SDK
• Python SDK
• OpenAI Python SDK
• OpenAI Node SDK

import Portkey from 'portkey-ai'

const portkey = new Portkey({
    apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
    virtualKey: "VIRTUAL_KEY" // Your Replicate Virtual Key
})

​

3. Use the Portkey SDK to interact with Replicate

• Python
• NodeJS
• OpenAI NodeJS
• OpenAI Python
• cURL

from portkey_ai import Portkey

portkey = Portkey(
    api_key="PORTKEY_API_KEY",  # Replace with your Portkey API key
    virtual_key="REPLICATE_VIRTUAL_KEY",
)

response = portkey.post(
    url="predictions", # Replace with the endpoint you want to call
)

print(response)