base_url
as PORTKEY_GATEWAY_URL
default_headers
to consume the headers needed by Portkey using the createHeaders
helper method.ChatOpenAI
model in Langchain
llama-3-70b
and gpt-3.5
50:50 to test the two large models. The gateway configuration for this would look like the following: