xAI

Portkey runs on our popular open source Gateway. You can spin it up locally to make requests without sending them to the Portkey API.

Then, just change the baseURL to the local Gateway URL, and make requests:

Portkey’s data & control planes can be fully deployed on-prem with the Enterprise license.

More details here

Process images alongside text using xAI’s vision capabilities:

Generate embeddings for text using xAI’s embedding models:

Coming Soon!

Here’s a simplified version of how to use Portkey’s Gateway Configuration:

config = {
  "strategy": {
    "mode": "conditional",
    "conditions": [
      {
        "query": { "metadata.user_plan": { "$eq": "paid" } },
        "then": "grok-beta"
      },
      {
        "query": { "metadata.user_plan": { "$eq": "free" } },
        "then": "grok-2-1212"
      }
    ],
    "default": "grok-beta"
  },
  "targets": [
    {
      "name": "grok-beta",
      "virtual_key": "xx"
    },
    {
      "name": "grok-2-1212",
      "virtual_key": "yy"
    }
  ]
}

That’s it! Portkey seamlessly allows you to make your AI app more robust using built-in gateway features. Learn more about advanced gateway features:

Portkey’s AI gateway enables you to enforce input/output checks on requests by applying custom hooks before and after processing. Protect your user’s/company’s data by using PII guardrails and many more available on Portkey Guardrails:

{
	"virtual_key":"xai-xxx",
	"before_request_hooks": [{
		"id": "input-guardrail-id-xx"
	}],
	"after_request_hooks": [{
		"id": "output-guardrail-id-xx"
	}]
}

You can sign up to xAI here and grab your API key.

xAI typically gives some amount of free credits without you having to add your credit card. Reach out to their support team if you’d like additional free credits.

You can find your current rate limits imposed by xAI on the console. Use Portkey’s loadbalancer to tackle rate limiting by xAI.