> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

> Use Groq's ultra-fast inference for chat completions, tool calling, and audio processing through Prisma AIRS AI Gateway.

## Quick Start

Get started with Groq in under 2 minutes:

<CodeGroup>
  ```sh cURL icon="square-terminal" theme={"system"}
  # 1. Add @groq provider in model catalog
  # 2. Use it:

  curl https://aigw.portkey.ai/v1/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $PORTKEY_API_KEY" \
    -d '{
      "model": "@groq/llama-3.3-70b-versatile",
      "messages": [{"role": "user", "content": "Hello!"}]
    }'
  ```

  ```python OpenAI Py icon="python" theme={"system"}
  from openai import OpenAI

  # 1. Install: pip install openai
  # 2. Add @groq provider in model catalog
  # 3. Use it:

  client = OpenAI(
      api_key="PORTKEY_API_KEY",  # AI Gateway API key
      base_url="https://aigw.portkey.ai/v1"
  )

  response = client.chat.completions.create(
      model="@groq/llama-3.3-70b-versatile",
      messages=[{"role": "user", "content": "Hello!"}]
  )

  print(response.choices[0].message.content)
  ```

  ```js OpenAI JS icon="square-js" theme={"system"}
  import OpenAI from "openai"

  // 1. Install: npm install openai
  // 2. Add @groq provider in model catalog
  // 3. Use it:

  const client = new OpenAI({
      apiKey: "PORTKEY_API_KEY",  // AI Gateway API key
      baseURL: "https://aigw.portkey.ai/v1"
  })

  const response = await client.chat.completions.create({
      model: "@groq/llama-3.3-70b-versatile",
      messages: [{ role: "user", content: "Hello!" }]
  })

  console.log(response.choices[0].message.content)
  ```
</CodeGroup>

## Add Provider in Model Catalog

Before making requests, add Groq to your Model Catalog:

1. Go to [**Model Catalog → Add Provider**](https://stratacloudmanager.paloaltonetworks.com/)
2. Select **Groq**
3. Enter your [Groq API key](https://console.groq.com/keys)
4. Name your provider (e.g., `groq`)

<Card title="Complete Setup Guide" icon="book" href="/docs/aigw/product/model-catalog">
  See all setup options and detailed configuration instructions
</Card>

***

## Groq Capabilities

### Tool Calling

Use Groq's tool calling feature to trigger external functions:

<CardGroup>
  <Card title="Supported Models" href="https://console.groq.com/docs/tool-use#supported-models">
    View Groq models that support tool calling
  </Card>
</CardGroup>

<CodeGroup>
  ```bash cURL theme={"system"}
  curl https://aigw.portkey.ai/v1/chat/completions \
       -H "Content-Type: application/json" \
      -H "Authorization: Bearer $PORTKEY_API_KEY" \
       -d '{
         "model": "@groq/llama-3.3-70b-versatile",
         "messages": [
           {"role": "system", "content": "You are a helpful assistant."},
              {"role": "user", "content": "What'\''s the weather like in Delhi?"}
         ],
         "tools": [{
           "type": "function",
           "function": {
             "name": "getWeather",
             "description": "Get the current weather",
             "parameters": {
               "type": "object",
               "properties": {
                 "location": {"type": "string", "description": "City and state"},
                 "unit": {"type": "string", "enum": ["celsius", "fahrenheit"]}
               },
               "required": ["location"]
             }
           }
         }],
         "tool_choice": "auto"
       }'
  ```
</CodeGroup>

### Speech to Text (Whisper)

Transcribe or translate audio using Groq's Whisper model:

<CodeGroup>
  ```bash cURL theme={"system"}
  # Transcription
  curl https://aigw.portkey.ai/v1/audio/transcriptions \
      -H "Authorization: Bearer $PORTKEY_API_KEY" \
      -H "x-portkey-provider: @groq" \
       -H "Content-Type: multipart/form-data" \
       -F "file=@/path/to/file.mp3" \
       -F "model=whisper-large-v3"

  # Translation
  curl https://aigw.portkey.ai/v1/audio/translations \
      -H "Authorization: Bearer $PORTKEY_API_KEY" \
      -H "x-portkey-provider: @groq" \
       -H "Content-Type: multipart/form-data" \
       -F "file=@/path/to/file.mp3" \
       -F "model=whisper-large-v3"
  ```
</CodeGroup>

### Text to Speech

Convert text to natural-sounding audio:

<CodeGroup>
  ```bash cURL theme={"system"}
  curl https://aigw.portkey.ai/v1/audio/speech \
      -H "Authorization: Bearer $PORTKEY_API_KEY" \
       -H "Content-Type: application/json" \
       -d '{
         "model": "@groq/playai-tts",
         "voice": "Fritz-PlayAI",
         "input": "Today is a wonderful day to build something people love!"
       }' \
       --output speech.mp3
  ```
</CodeGroup>

***

## Supported Models

<Card title="Groq Models" icon="list" href="https://console.groq.com/docs/models">
  View the complete list of models available on Groq
</Card>

***

## Next Steps

<CardGroup cols={2}>
  <Card title="Gateway Configs" icon="sliders" href="/docs/aigw/product/ai-gateway">
    Add fallbacks, load balancing, and more
  </Card>

  <Card title="Observability" icon="chart-line" href="/docs/aigw/product/observability">
    Monitor and trace your Groq requests
  </Card>

  <Card title="Metadata" icon="tag" href="/docs/aigw/product/observability/metadata">
    Add custom metadata to requests
  </Card>
</CardGroup>


## Related topics

- [Enterprise Gateway](/docs/aigw/changelog/enterprise.md)
- [Open Responses](/docs/aigw/product/ai-gateway/responses-api.md)
- [Prisma AIRS AI Gateway Models](/docs/aigw/product/model-catalog/gateway-models.md)
- [Overview](/docs/aigw/integrations/llms.md)
- [Messages](/docs/aigw/product/ai-gateway/messages-api.md)