Invalid sampling parameter: top_p must be set to 1 when using greedy sampling.

The "400 Bad Request" error in the Mistral AI API, specifically the message indicating that top_p must be 1 when using greedy sampling, is due to the following reasons:

Invalid Request Parameters

The error occurs because the request contains invalid or incompatible parameters. In this case, the top_p parameter, which is used for nucleus sampling, is not compatible with the greedy sampling method. Greedy sampling requires top_p to be set to 1, as it selects the most likely next token without considering a probability distribution[4%.

API Configuration and Constraints

The API has specific constraints and requirements for the parameters that can be used together. When these constraints are not met, the API responds with a 400 error indicating that the request is malformed or contains invalid parameters.

Request Syntax or Configuration

The error also suggests that there might be an issue with the syntax or configuration of the request itself. This could include incorrect headers, missing required fields, or other configuration errors that prevent the server from understanding the request.