anyscale
#10004
validation_error
Invalid configuration: "top_p" must be set to 1 when using greedy sampling. Please adjust your settings accordingly.
This error has been identified and solved.
Reason
The 400 status error you are seeing in the Anyscale API is due to a client error in the request. Specifically, the error message top_p must be 1 when using greedy sampling indicates that the request contains invalid parameters. In this case, the top_p parameter, which is used for sampling, is not set to 1 as required when the greedy sampling method is used. This mismatch between the sampling method and the top_p value results in a malformed request, leading to a 400 Bad Request error.
Solution
To fix the 400 status error in the Anyscale API, you need to ensure that your request configuration is valid. Here are the steps to resolve the issue:
Adjust your API request to set the top_p parameter to 1 when using greedy sampling. Here are the key points to consider:
Set
top_pto 1 for greedy sampling.Ensure all other parameters are correctly configured according to the API requirements.
Double-check that there are no extra or unsupported fields in your request.
By making these adjustments, you should be able to resolve the invalid configuration error and successfully make the API call.
