ollama
customHost
property.
customHost
without the version identifier (such as /v1
) - Portkey takes care of the rest!OpenAI
)Custom Host
fieldYour Gateway is running on http://localhost:8080/v1 🚀 |
---|
baseURL
to the Gateway URL, customHost
to the Ollam URL, and make requests.
Docker container
, but Ollama is running natively on your machine (i.e. not in Docker), you will have to refer to Ollama using http://host.docker.internal:11434
for the Gateway to be able to call it.