Portkey API has first-class support for monitoring and routing your requests to 10+ provider endpoints, like /chat/completions, /audio, /embeddings, etc. We also make these endpoints work across 250+ different LLMs.

However, there are still many endpoints like Cohere’s /rerank or Deepgram’s /listen that are uncommon or have niche use cases.

With the Gateway to Other APIs feature, you can route to any custom provider endpoint using Portkey (including the ones hosted on your private setups) and get complete logging & monitoring for all your requests.

​

How to Integrate

1. Get your Portkey API key
2. Add your provider details to Portkey
3. Make your request using Portkey’s API or SDK

​

1. Get Portkey API Key

Create or log in to your Portkey account. Grab your account’s API key from the “API Keys” page.

​

2. Add Provider Details

Choose one of these authentication methods:

​

3. Make Requests

• cURL
• Python SDK
• NodeJS SDK

curl --request POST \
     --url https://api.portkey.ai/v1/rerank \
     --header 'Content-Type: application/json' \
     --header 'x-portkey-api-key: $PORTKEY_API_KEY' \
     --header 'x-portkey-virtual-key: $COHERE_VIRTUAL_KEY' \
     --data '{
       "model": "rerank-english-v2.0",
       "query": "What is machine learning?",
       "documents": [
         "Machine learning is a branch of AI focused on building systems that learn from data.",
         "Data science involves analyzing and interpreting complex data sets."
       ]
     }'

​

End-to-end Example

from portkey_ai import Portkey

portkey = Portkey(
    api_key="PORTKEY_API_KEY",
    virtual_key="COHERE_VIRTUAL_KEY"
)

response = portkey.post(
    '/rerank',
    return_documents=False,
    max_chunks_per_doc=10,
    model="rerank-english-v2.0",
    query="What is the capital of the United States?",
    documents=[
        "Carson City is the capital city of the American state of Nevada.",
        "Washington, D.C. is the capital of the United States.",
        "Capital punishment has existed in the United States since before its founding."
    ]
)

​

Caveats & Considerations

• Response objects are returned exactly as received from the provider, without Portkey transformations
• REST API supports all HTTP methods
• SDK currently supports POST only (more methods coming soon)
• There are no limitations on which provider endpoints can be proxied
• All requests are logged and monitored through your Portkey dashboard

​

Support

Need help? Join our Developer Forum for support and discussions.