> ## Documentation Index
> Fetch the complete documentation index at: https://docs.portkey.ai/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Lambda Labs

> Use Lambda's GPU-powered inference for Llama and open-source models through Prisma AIRS AI Gateway.

## Quick Start

Get started with Lambda Labs in under 2 minutes:

<CodeGroup>
  ```sh cURL icon="square-terminal" theme={"system"}
  # 1. Add @lambda provider in model catalog
  # 2. Use it:

  curl https://aigw.portkey.ai/v1/chat/completions \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $PORTKEY_API_KEY" \
    -d '{
      "model": "@lambda/llama3.1-8b-instruct",
      "messages": [{"role": "user", "content": "Hello!"}]
    }'
  ```

  ```python OpenAI Py icon="python" theme={"system"}
  from openai import OpenAI

  # 1. Install: pip install openai
  # 2. Add @lambda provider in model catalog
  # 3. Use it:

  client = OpenAI(
      api_key="PORTKEY_API_KEY",  # AI Gateway API key
      base_url="https://aigw.portkey.ai/v1"
  )

  response = client.chat.completions.create(
      model="@lambda/llama3.1-8b-instruct",
      messages=[{"role": "user", "content": "Hello!"}]
  )

  print(response.choices[0].message.content)
  ```

  ```js OpenAI JS icon="square-js" theme={"system"}
  import OpenAI from "openai"

  // 1. Install: npm install openai
  // 2. Add @lambda provider in model catalog
  // 3. Use it:

  const client = new OpenAI({
      apiKey: "PORTKEY_API_KEY",  // AI Gateway API key
      baseURL: "https://aigw.portkey.ai/v1"
  })

  const response = await client.chat.completions.create({
      model: "@lambda/llama3.1-8b-instruct",
      messages: [{ role: "user", content: "Hello!" }]
  })

  console.log(response.choices[0].message.content)
  ```
</CodeGroup>

## Add Provider in Model Catalog

Before making requests, add Lambda Labs to your Model Catalog:

1. Go to [**Model Catalog → Add Provider**](https://stratacloudmanager.paloaltonetworks.com/)
2. Select **Lambda Labs**
3. Enter your [Lambda API key](https://cloud.lambdalabs.com/api-keys)
4. Name your provider (e.g., `lambda`)

<Card title="Complete Setup Guide" icon="book" href="/docs/aigw/product/model-catalog">
  See all setup options and detailed configuration instructions
</Card>

***

## Lambda Capabilities

### Streaming

Stream responses for real-time output:

### Function Calling

Use Lambda's function calling capabilities:

***

## Supported Endpoints and Parameters

| Endpoint            | Supported Parameters                                                                                                                                               |
| ------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| `/chat/completions` | messages, max\_tokens, temperature, top\_p, stream, presence\_penalty, frequency\_penalty, tools, tool\_choice                                                     |
| `/completions`      | model, prompt, max\_tokens, temperature, top\_p, n, stream, logprobs, echo, stop, presence\_penalty, frequency\_penalty, best\_of, logit\_bias, user, seed, suffix |

Check [Lambda's documentation](https://docs.lambdalabs.com/) for more details.

***

## Next Steps

<CardGroup cols={2}>
  <Card title="Gateway Configs" icon="sliders" href="/docs/aigw/product/ai-gateway">
    Add fallbacks, load balancing, and more
  </Card>

  <Card title="Observability" icon="chart-line" href="/docs/aigw/product/observability">
    Monitor and trace your Lambda requests
  </Card>

  <Card title="Metadata" icon="tag" href="/docs/aigw/product/observability/metadata">
    Add custom metadata to requests
  </Card>
</CardGroup>


## Related topics

- [Modal Labs](/docs/aigw/integrations/llms/modal.md)
- [ElevenLabs](/docs/aigw/integrations/llms/elevenlabs.md)
- [AWS Marketplace](/docs/aigw/self-hosting/hybrid-deployments/aws/marketplace.md)
- [Gitlab MCP server](/docs/aigw/integrations/mcp-servers/gitlab-mcp-server.md)
- [Prometheus Metrics](/docs/aigw/self-hosting/prometheus-metrics.md)