Get the LLM to adhere to your JSON schema using Anyscale & Together AI’s newly introduced JSON modes
response_format
param. The response_format
’s type
is json_object
and the schema
contains all keys and their expected type.
Model/Provider | Ensure JSON | Ensure Schema |
---|---|---|
mistralai/Mistral-7B-Instruct-v0.1 Anyscale | ||
mistralai/Mixtral-8x7B-Instruct-v0.1Anyscale | ||
mistralai/Mixtral-8x7B-Instruct-v0.1Together AI | ||
mistralai/Mistral-7B-Instruct-v0.1Together AI | ||
togethercomputer/CodeLlama-34b-InstructTogether AI | ||
gpt-4 and previous releases OpenAI / Azure OpenAI | ||
gpt-3.5-turbo and previous releases OpenAI / Azure OpenAI | ||
Ollama models |