Generative AI models have revolutionized text generation and opened up new possibilities for developers.
base_url
to Portkey Gateway and add defaultHeaders
while instantiating your OpenAI client, and you’re good to go
Import the openai
and portkey_ai
libraries to send the requests, whereas the rest of the utility libraries will help decode the base64 response and print them onto Jupyter Notebook.
api_key
parameter is passed a random string since it’s redundant as the request will be handled through Portkey.
To generate an image:
fallback
strategy, where the primary target to forward requests to is Stability AI (automatically inferred from the virtual key) and then to OpenAI. The override_params
let’s you override the default models for the provider. Finally, surprise surprise! — we also enabled caching with just one more key-value pair.
Learn about Gateway Configs and Caching from the docs.
Hit Save Config on the top right corner and grab the **Config ID. **Next up, we are going to use the _Config ID _in our requests to activate fallback mechanism.
config
parameter. The request is sent through Portkey and uses saved gateway configs as references to activate the fallback mechanism.