MindsDB

MindsDB connects data sources and LLMs for AI automation. The AI Gateway adds:

3,000+ LLMs — Access any provider through MindsDB
Observability — Track costs, latency, and usage
Reliability — Caching, routing, guardrails via Configs

Prerequisites

Install MindsDB via Docker or Docker Desktop
Install the AI Gateway dependencies per MindsDB instructions
Get your AI Gateway API key

Setup

Create AI Engine

CREATE ML_ENGINE portkey_engine
FROM portkey
USING
    portkey_api_key = 'PORTKEY_API_KEY',
    config = 'pc-your-config-id';

CREATE ML_ENGINE portkey_engine
FROM portkey
USING
    portkey_api_key = 'PORTKEY_API_KEY',
    provider = '@openai-prod';

Use Configs to add guardrails, caching, conditional routing, and more.

Create Model

CREATE MODEL portkey_model
PREDICT answer
USING
    engine = 'portkey_engine',
    temperature = 0.2;

Query

SELECT question, answer
FROM portkey_model
WHERE question = 'Where is Stockholm located?';

Output:

+-----------------------------+--------------------------------------------------------------------------------+
| question                    | answer                                                                         |
+-----------------------------+--------------------------------------------------------------------------------+
| Where is Stockholm located? | Stockholm is the capital of Sweden, located on the south-central east coast... |
+-----------------------------+--------------------------------------------------------------------------------+

Next Steps

MindsDB Use Cases

Explore MindsDB examples

AI Gateway Configs

Add routing, caching, guardrails

Last modified on September 15, 2026

Integrations

LLM Integrations

Cloud Platforms

Guardrails

Plugins

Vector Databases

Agents

AI Apps

Libraries

Tracing Providers

MCP Clients

MCP Servers

Prerequisites

Setup

Next Steps

MindsDB Use Cases

AI Gateway Configs

​Prerequisites

​Setup

​Next Steps

MindsDB Use Cases

AI Gateway Configs

Prerequisites

Setup

Next Steps