AWS SageMaker

Sagemaker allows users to host any ML model on their own AWS infrastructure. With the AI Gateway you can manage/restrict access, log requests, and more.

Quick Start

# 1. Add @sagemaker provider in Model Catalog
# 2. Use it:

curl https://aigw.portkey.ai/v1/endpoints/{endpoint_name}/invocations \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $PORTKEY_API_KEY" \
  -d '{
    "inputs": "my_custom_value",
    "my_custom_key": "my_custom_value"
  }'

Add Provider in Model Catalog

Navigate to Model Catalog

Go to Model Catalog → Add Provider in Strata Cloud Manager.

Select AWS Sagemaker

Find and select AWS Sagemaker from the provider list.

Configure AWS Credentials

There are two authentication methods:

Here’s how to find your AWS credentials:

AWS Access Key

Use your AWS Secret Access Key, AWS Access Key Id, and AWS Region to create your provider.Integration Guide

AWS Assumed Role

Take your AWS Assumed Role ARN and AWS Region to create the provider.Integration Guide

Enter your AWS credentials and deployment details for your Sagemaker endpoint.

Save and Use

Save your configuration. Your provider slug will be @sagemaker (or a custom name you specify).

Direct Integration Without Model Catalog

If you prefer not to store your AWS credentials in the AI Gateway, you can pass them directly when instantiating the AI Gateway client.

Supported Parameters

These parameters are supported for Sagemaker (not required if you’re using Model Catalog):

Node SDK	Python SDK	REST Headers
awsAccessKeyId	aws_access_key_id	x-portkey-aws-access-key-id
awsSecretAccessKey	aws_secret_access_key	x-portkey-aws-secret-access-key
awsRegion	aws_region	x-portkey-aws-region
awsSessionToken	aws_session_token	x-portkey-aws-session-token
sagemakerCustomAttributes	sagemaker_custom_attributes	x-portkey-amzn-sagemaker-custom-attributes
sagemakerTargetModel	sagemaker_target_model	x-portkey-amzn-sagemaker-target-model
sagemakerTargetVariant	sagemaker_target_variant	x-portkey-amzn-sagemaker-target-variant
sagemakerTargetContainerHostname	sagemaker_target_container_hostname	x-portkey-amzn-sagemaker-target-container-hostname
sagemakerInferenceId	sagemaker_inference_id	x-portkey-amzn-sagemaker-inference-id
sagemakerEnableExplanations	sagemaker_enable_explanations	x-portkey-amzn-sagemaker-enable-explanations
sagemakerInferenceComponent	sagemaker_inference_component	x-portkey-amzn-sagemaker-inference-component
sagemakerSessionId	sagemaker_session_id	x-portkey-amzn-sagemaker-session-id
sagemakerModelName	sagemaker_model_name	x-portkey-amzn-sagemaker-model-name

Example

curl https://aigw.portkey.ai/v1/endpoints/{endpoint_name}/invocations \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $PORTKEY_API_KEY" \
  -H "x-portkey-provider: @sagemaker" \
  -H "x-portkey-aws-access-key-id: $AWS_ACCESS_KEY_ID" \
  -H "x-portkey-aws-secret-access-key: $AWS_SECRET_ACCESS_KEY" \
  -H "x-portkey-aws-region: $AWS_REGION" \
  -H "x-portkey-amzn-sagemaker-inference-component: $SAGEMAKER_INFERENCE_COMPONENT" \
  -d '{
    "inputs": "my_custom_value",
    "my_custom_key": "my_custom_value"
  }'

Next Steps

Add Metadata

Add metadata to your Sagemaker requests

Gateway Configs

Configure advanced gateway features

Tracing

Trace and monitor your Sagemaker requests

Last modified on September 15, 2026

Integrations

LLM Integrations

Cloud Platforms

Guardrails

Plugins

Vector Databases

Agents

AI Apps

Libraries

Tracing Providers

MCP Clients

MCP Servers

Quick Start

Add Provider in Model Catalog

AWS Access Key

AWS Assumed Role

Direct Integration Without Model Catalog

Supported Parameters

Example

Next Steps

Add Metadata

Gateway Configs

Tracing

​Quick Start

​Add Provider in Model Catalog

AWS Access Key

AWS Assumed Role

​Direct Integration Without Model Catalog

​Supported Parameters

​Example

​Next Steps

Add Metadata

Gateway Configs

Tracing

Quick Start

Add Provider in Model Catalog

Direct Integration Without Model Catalog

Supported Parameters

Example

Next Steps