Oracle Cloud Infrastructure

Portkey SDK Integration with Oracle OCI
1. Install the Portkey SDK
2. Initialize Portkey with Oracle OCI
3. Invoke Chat Completions
Supported Models
Configuration Options
Next Steps

Portkey provides a robust and secure gateway to facilitate the integration of various Large Language Models (LLMs) into your applications, including Oracle Cloud Infrastructure (OCI) Generative AI.

Provider Slug: oracle

Portkey SDK Integration with Oracle OCI

Portkey provides a consistent API to interact with models from various providers. To integrate Oracle OCI Generative AI with Portkey:

1. Install the Portkey SDK

NodeJS
Python

npm install --save portkey-ai

pip install portkey-ai

2. Initialize Portkey with Oracle OCI

Oracle OCI uses API key-based authentication with request signing. You’ll need the following credentials from your OCI console:

Parameter	Description
`oracleRegion`	OCI region (e.g., `us-chicago-1`, `eu-frankfurt-1`)
`oracleTenancy`	Your OCI tenancy OCID
`oracleCompartmentId`	Your OCI compartment OCID
`oracleUser`	Your OCI user OCID
`oracleFingerprint`	API key fingerprint
`oraclePrivateKey`	Private key content (PEM format)
`oracleKeyPassphrase`	(Optional) Passphrase for encrypted private key

Add these credentials to Portkey to create your Oracle virtual key.

NodeJS SDK
Python SDK

import Portkey from 'portkey-ai'

const portkey = new Portkey({
    apiKey: "PORTKEY_API_KEY", // defaults to process.env["PORTKEY_API_KEY"]
    provider: "@ORACLE_PROVIDER" // Your Oracle OCI virtual key
})

from portkey_ai import Portkey

portkey = Portkey(
    api_key="PORTKEY_API_KEY",  # Replace with your Portkey API key
    provider="@ORACLE_PROVIDER" # Your Oracle OCI virtual key
)

3. Invoke Chat Completions

NodeJS SDK
Python SDK
cURL

const chatCompletion = await portkey.chat.completions.create({
    messages: [{ role: 'user', content: 'Say this is a test' }],
    model: 'cohere.command-r-plus',
});

console.log(chatCompletion.choices);

completion = portkey.chat.completions.create(
    messages=[{ "role": "user", "content": "Say this is a test" }],
    model="cohere.command-r-plus"
)

print(completion)

curl https://api.portkey.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -H "x-portkey-provider: @ORACLE_PROVIDER" \
  -d '{
    "model": "cohere.command-r-plus",
    "messages": [
      { "role": "user", "content": "Say this is a test" }
    ]
  }'

Supported Models

Oracle OCI Generative AI supports various foundation models including:

Cohere Models: cohere.command-r-plus, cohere.command-r, cohere.command
Meta Llama Models: meta.llama-3.1-405b-instruct, meta.llama-3.1-70b-instruct

For the complete list of available models, refer to the Oracle OCI Generative AI documentation.

Configuration Options

You can specify the API version using the oracleApiVersion parameter (defaults to 20231130).

Next Steps

The complete list of features supported in the SDK are available on the link below.

SDK

You’ll find more information in the relevant sections:

Nebius OpenRouter

⌘I

Ecosystem

LLM Integrations

Cloud Platforms

Guardrails

Plugins

Vector Databases

Agents

AI Apps

Libraries

Tracing Providers

MCP Clients

MCP Servers

Oracle Cloud Infrastructure

Portkey SDK Integration with Oracle OCI

1. Install the Portkey SDK

2. Initialize Portkey with Oracle OCI

3. Invoke Chat Completions

Supported Models

Configuration Options

Next Steps

SDK

Ecosystem

LLM Integrations

Cloud Platforms

Guardrails

Plugins

Vector Databases

Agents

AI Apps

Libraries

Tracing Providers

MCP Clients

MCP Servers

​Portkey SDK Integration with Oracle OCI

​1. Install the Portkey SDK

​2. Initialize Portkey with Oracle OCI

​3. Invoke Chat Completions

​Supported Models

​Configuration Options

​Next Steps

SDK

Portkey SDK Integration with Oracle OCI

1. Install the Portkey SDK

2. Initialize Portkey with Oracle OCI

3. Invoke Chat Completions

Supported Models

Configuration Options

Next Steps