Portkey’s AI Gateway supports function calling capabilities that many foundational model providers offer. In the API call you can describe functions and the model can choose to output text or this function name with parameters.
tools
parameter accepts functions which can be sent specifically for models that support function/tool calling.
tool choice
param. Portkey will also validate your tool definition on the fly, eliminating syntax errors.
Provider | Models |
---|---|
OpenAI | gpt-4 series of modelsgpt-3.5-turbo series of models |
Azure OpenAI | gpt-4 series of modelsgpt-3.5-turbo series of models |
Anyscale | mistralai/Mistral-7B-Instruct-v0.1 mistralai/Mixtral-8x7B-Instruct-v0.1 |
Together AI | mistralai/Mixtral-8x7B-Instruct-v0.1 mistralai/Mistral-7B-Instruct-v0.1 togethercomputer/CodeLlama-34b-Instruct |
Fireworks AI | firefunction-v1fw-function-call-34b-v0 |
Google Gemini / Vertex AI | gemini-1.0-progemini-1.0-pro-001gemini-1.5-pro-latest |