Mistral

Documentation Index

Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt

Use this file to discover all available pages before exploring further.

​

Using Mistral with Portkey

​

1. Add Mistral Credentials to Portkey

• Navigate to the Integrations page under Settings
• Click on the edit button for the Mistral integration
• Add your Mistral La Plateforme API Key (obtain this from your Mistral account)

​

2. Add Mistral’s Guardrail Check

• Navigate to the Guardrails page and click the Create button
• Search for “Moderate Content” and click Add
• Configure your moderation checks by selecting which categories to filter:
  • Sexual
  • Hate and discrimination
  • Violence and threats
  • Dangerous and criminal content
  • Selfharm
  • Health
  • Financial
  • Law
  • PII (Personally Identifiable Information)
• Set the timeout in milliseconds (default: 5000ms)
• Set any actions you want on your check, and create the Guardrail!

​

3. Add Guardrail ID to a Config and Make Your Request

• When you save a Guardrail, you’ll get an associated Guardrail ID - add this ID to the input_guardrails or output_guardrails params in your Portkey Config
• Create these Configs in Portkey UI, save them, and get an associated Config ID to attach to your requests. More here.

{
  "input_guardrails": ["guardrails-id-xxx", "guardrails-id-yyy"],
  "output_guardrails": ["guardrails-id-xxx", "guardrails-id-yyy"]
}

const portkey = new Portkey({
    apiKey: "PORTKEY_API_KEY",
    config: "pc-***" // Supports a string config id or a config object
});

portkey = Portkey(
    api_key="PORTKEY_API_KEY",
    config="pc-***" # Supports a string config id or a config object
)

const openai = new OpenAI({
  apiKey: 'OPENAI_API_KEY',
  baseURL: PORTKEY_GATEWAY_URL,
  defaultHeaders: createHeaders({
    apiKey: "PORTKEY_API_KEY",
    config: "CONFIG_ID"
  })
});

client = OpenAI(
    api_key="OPENAI_API_KEY", # defaults to os.environ.get("OPENAI_API_KEY")
    base_url=PORTKEY_GATEWAY_URL,
    default_headers=createHeaders(
        provider="openai",
        api_key="PORTKEY_API_KEY", # defaults to os.environ.get("PORTKEY_API_KEY")
        config="CONFIG_ID"
    )
)

curl https://api.portkey.ai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $OPENAI_API_KEY" \
  -H "x-portkey-api-key: $PORTKEY_API_KEY" \
  -H "x-portkey-config: $CONFIG_ID" \
  -d '{
    "model": "gpt-3.5-turbo",
    "messages": [{
        "role": "user",
        "content": "Hello!"
      }]
  }'

​

Content Moderation Categories

1. Sexual: Content of sexual nature or adult content
2. Hate and Discrimination: Content expressing hatred or promoting discrimination
3. Violence and Threats: Content depicting violence or threatening language
4. Dangerous and Criminal Content: Instructions for illegal activities or harmful actions
5. Self-harm: Content related to self-injury, suicide, or eating disorders
6. Health: Unqualified medical advice or health misinformation
7. Financial: Unqualified financial advice or dubious investment schemes
8. Law: Unqualified legal advice or recommendations
9. PII: Personally identifiable information, including email addresses, phone numbers, etc.

​

Get Support

​

Learn More

• Mistral AI Website
• Mistral Moderation Documentation