Structured Outputs ensure that the model always follows your supplied JSON schema. Portkey supports OpenAI’s Structured Outputs feature out of the box with our SDKs & APIs.
JSON Mode
as well as Function Calling
. Check out this table for a quick comparison.response_format
.
response_format
, you can set it as { "type": "json_object" }
to enable the JSON Mode.{ "type": "json_schema" }
to use the Structured Outputs Mode described above.