google
system_instructions
parameter for Google Gemini 1.5 - allowing you to control the behavior and output of your Gemini-powered applications with ease.Simply include your Gemini system prompt as part of the {"role":"system"}
message within the messages
array of your request body. Portkey Gateway will automatically transform your message to ensure seamless compatibility with the Google Gemini API.type: 'image_url'
within the user message’s content
array.Portkey’s AI Gateway intelligently interprets your request—based on the URL or data URI you provide—and translates it into the precise format required by the Google Gemini API. This means you only need to learn one structure for all your media processing needs.https://generativelanguage.googleapis.com/v1beta/files/[FILE_ID]
data:<MIME_TYPE>;base64,<YOUR_BASE64_DATA>
image/png
, image/jpeg
, image/webp
, image/heic
, image/heif
audio/wav
, audio/mp3
, audio/aiff
, audio/aac
, audio/ogg
, audio/flac
video/mp4
, video/mpeg
, video/mov
, video/avi
, video/webm
, video/wmv
.txt
or .html
, they will be treated as plain text. Gemini’s native document vision capabilities are optimized for the application/pdf
MIME type.code_execution
tool in your request. The model will automatically decide when to invoke it.
google_search
tool (for newer models like gemini-2.0-flash-001), and google_search_retrieval
(for older models like gemini-1.5-flash) in the tools
array.
response_chunk.choices[0].delta.content_blocks
array, not the response.choices[0].message.content
string.gemini-2.5-flash-preview-04-17
gemini-2.5-flash-preview-04-17
support extended thinking.
This is similar to openai thinking, but you get the model’s reasoning as it processes the request as well.
Note that you will have to set strict_open_ai_compliance=False
in the headers to use this feature.
gemini-2.5-flash-preview-04-17
, you are required to explicitly set budget_tokens
to 0
.