Triggers allow you to schedule agent executions on a cron schedule, enabling automated and recurring tasks.
CreateTrigger
Creates a new trigger that will invoke the specified agent on the given cron schedule.
Request body
The request body contains data with the following structure:
Optional. The display name of the trigger.
Optional. The environment ID for the trigger execution.
Optional. The execution timeout for the triggered interaction.
Required. The interaction request template to be executed.
Optional. The maximum number of consecutive failures allowed before the trigger is automatically paused (status becomes ERROR).
Required. The cron schedule on which the trigger should run. Standard cron format.
Required. Time zone in which the schedule should be interpreted.
Response
If successful, the response body contains data with the following structure:
Output only. The number of consecutive failures that have occurred since the last successful execution.
Output only. The time when the trigger was created.
Optional. The display name of the trigger.
Optional. The environment ID for the trigger execution.
Optional. The execution timeout for the triggered interaction.
Required. Output only. Identifier. The ID of the trigger.
interaction Interaction (optional)
Required. The interaction request template to be executed.
Fields
agent AgentOption (optional)
The name of the `Agent` used for generating the interaction.
Possible values
-
deep-research-pro-preview-12-2025Gemini Deep Research Agent
-
deep-research-preview-04-2026Gemini Deep Research Agent
-
deep-research-max-preview-04-2026Gemini Deep Research Max Agent
-
antigravity-preview-05-2026Use the Antigravity managed agent to perform multi-step tasks that require reasoning, file operations, and tool use.
agent_config object (optional)
Configuration parameters for the agent interaction.
Possible Types
Polymorphic discriminator: type
AntigravityAgentConfig
Configuration for the Antigravity agent runtime. Provides server-side control over the agent's execution environment and tool configuration.
Max total tokens for the agent run.
The model to use for agent reasoning.
No description provided.
Always set to "antigravity".
DeepResearchAgentConfig
Configuration for the Deep Research agent.
Enables human-in-the-loop planning for the Deep Research agent. If set to true, the Deep Research agent will provide a research plan in its response. The agent will then proceed only if the user confirms the plan in the next turn.
thinking_summaries ThinkingSummaries (optional)
Whether to include thought summaries in the response.
Possible values
-
autoAuto thinking summaries.
-
noneNo thinking summaries.
No description provided.
Always set to "deep-research".
Whether to include visualizations in the response.
Possible values:
-
offDo not include visualizations.
-
autoAutomatically include visualizations.
DynamicAgentConfig
Configuration for dynamic agents.
No description provided.
Always set to "dynamic".
Output only. The time at which the response was created in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
environment EnvironmentConfig or string (optional)
The environment configuration for the interaction. Can be an object specifying remote environment sources or a string referencing an existing environment ID.
Fields
Optional. The environment ID for the interaction. If specified, the request will update the existing environment instead of creating a new one.
network EnvironmentNetworkEgressAllowlist or enum (string) (optional)
Network configuration for the environment.
Possible Types
object
Outbound networking configuration for the sandbox. When specified, restricts which external domains the sandbox can reach. Omit entirely to allow all outbound traffic with no header injection.
allowlist array (AllowlistEntry) (optional)
List of allowed outbound domains. Only requests to listed domains are permitted. Use [{'domain': '*'}] to allow all domains while still injecting headers on specific ones.
Fields
Domain to allow outbound requests to. Supports wildcards (e.g. '*.googleapis.com'). Use '*' to allow all domains.
Headers to inject on all outbound requests matching this domain. Accepts a single dict or a list of dicts. The egress proxy injects these automatically.
string
Turns all network off.
Possible values
-
disabledTurns all network off.
sources array (Source) (optional)
No description provided.
Fields
The inline content if `type` is `INLINE`.
Optional encoding for inline content (e.g. `base64`).
The source of the environment. For Cloud Storage, this is the Cloud Storage path. For GitHub, this is the GitHub path.
Where the source should appear in the environment.
No description provided.
Possible values:
-
gcsA Cloud Storage bucket.
-
inlineInline content.
-
repositoryA generic repository. The protocol prefix in the source URL identifies the provider (e.g., github://, gcs://).
No description provided.
Always set to "remote".
Output only. The environment ID for the interaction. Only populated if environment config is set in the request.
errors array (Error) (optional)
Output only. Diagnostic faults / platform errors recorded on the interaction.
Fields
A URI that identifies the error type.
A human-readable error message.
Required. Output only. A unique identifier for the interaction completion.
Defaults to:
The input for the interaction.
The labels with user-defined metadata for the request.
model ModelOption (optional)
The name of the `Model` used for generating the interaction.
Possible values
-
gemini-2.5-flashOur first hybrid reasoning model which supports a 1M token context window and has thinking budgets.
-
gemini-2.5-proOur state-of-the-art multipurpose model, which excels at coding and complex reasoning tasks.
-
gemma-4-26b-a4b-itGemma 4 26B A4B IT
-
gemma-4-31b-itGemma 4 31B IT
-
gemini-flash-latestLatest release of Gemini Flash
-
gemini-flash-lite-latestLatest release of Gemini Flash-Lite
-
gemini-pro-latestLatest release of Gemini Pro
-
gemini-2.5-flash-liteOur smallest and most cost effective model, built for at scale usage.
-
gemini-2.5-flash-imageOur native image generation model, optimized for speed, flexibility, and contextual understanding. Text input and output is priced the same as 2.5 Flash.
-
gemini-3-flash-previewOur most intelligent model built for speed, combining frontier intelligence with superior search and grounding.
-
gemini-3.1-pro-previewOur latest SOTA reasoning model with unprecedented depth and nuance, and powerful multimodal understanding and coding capabilities.
-
gemini-3.1-pro-preview-customtoolsGemini 3.1 Pro Preview optimized for custom tool usage
-
gemini-3.1-flash-liteOur most cost-efficient model, optimized for high-volume agentic tasks, translation, and simple data processing.
-
gemini-3-pro-imageGemini 3 Pro Image
-
nano-banana-pro-previewGemini 3 Pro Image Preview
-
gemini-3.1-flash-imageGemini 3.1 Flash Image.
-
gemini-3.5-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.6-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.7-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
lyria-3-clip-previewOur low-latency, music generation model optimized for high-fidelity audio clips and precise rhythmic control.
-
lyria-3-pro-previewOur advanced, full-song generative model with deep compositional understanding, optimized for precise structural control and complex transitions across diverse musical styles.
-
gemini-robotics-er-1.6-previewGemini Robotics-ER 1.6 Preview
-
gemini-robotics-er-2-previewGemini Robotics Embodied Reasoning 2 Preview
The ID of the previous interaction, if any.
response_format ResponseFormat or array (ResponseFormat) (optional)
Enforces that the generated response is a JSON object that complies with the JSON schema specified in this field.
Possible Types
AudioResponseFormat
Configuration for audio output format.
Bit rate in bits per second (bps). Only applicable for compressed formats (MP3, Opus).
The delivery mode for the audio output.
Possible values:
-
inlineAudio data is returned inline in the response.
-
uriAudio data is returned as a URI.
The MIME type of the audio output.
Possible values:
-
audio/mp3MP3 audio format.
-
audio/ogg_opusOGG Opus audio format.
-
audio/l16Raw PCM (L16) audio format.
-
audio/wavWAV audio format.
-
audio/alawA-law audio format.
-
audio/mulawMu-law audio format.
Sample rate in Hz.
No description provided.
Always set to "audio".
ImageResponseFormat
Configuration for image output format.
The aspect ratio for the image output.
Possible values:
-
1:11:1 aspect ratio.
-
2:32:3 aspect ratio.
-
3:23:2 aspect ratio.
-
3:43:4 aspect ratio.
-
4:34:3 aspect ratio.
-
4:54:5 aspect ratio.
-
5:45:4 aspect ratio.
-
9:169:16 aspect ratio.
-
16:916:9 aspect ratio.
-
21:921:9 aspect ratio.
-
1:81:8 aspect ratio.
-
8:18:1 aspect ratio.
-
1:41:4 aspect ratio.
-
4:14:1 aspect ratio.
The delivery mode for the image output.
Possible values:
-
inlineImage data is returned inline in the response.
-
uriImage data is returned as a URI.
The size of the image output.
Possible values:
-
512512px image size.
-
1K1K image size.
-
2K2K image size.
-
4K4K image size.
The MIME type of the image output.
Possible values:
-
image/jpegJPEG image format.
No description provided.
Always set to "image".
TextResponseFormat
Configuration for text output format.
The MIME type of the text output.
Possible values:
-
application/jsonJSON output format.
-
text/plainPlain text output format.
The JSON schema that the output should conform to. Only applicable when mime_type is application/json.
No description provided.
Always set to "text".
VideoResponseFormat
Configuration for video output format.
The aspect ratio for the video output.
Possible values:
-
16:916:9 aspect ratio.
-
9:169:16 aspect ratio.
The delivery mode for the video output.
Possible values:
-
inlineVideo data is returned inline in the response.
-
uriVideo data is returned as a URI.
The duration for the video output.
The video output resolution. Defaults to 720p.
Possible values:
-
360p360p resolution.
-
720p720p resolution.
-
1080p1080p resolution.
-
4k4K resolution.
No description provided.
Always set to "video".
Safety settings for the interaction.
service_tier ServiceTier (optional)
The service tier for the interaction.
Possible values
-
flexFlex service tier.
-
standardStandard service tier.
-
priorityPriority service tier.
Required. Output only. The status of the interaction.
Possible values:
-
in_progressThe interaction is in progress.
-
requires_actionThe interaction requires action/input from the user.
-
completedThe interaction is completed.
-
failedThe interaction failed.
-
cancelledThe interaction was cancelled.
-
incompleteThe interaction is completed, but contains incomplete results (e.g. hitting max_tokens).
-
budget_exceededThe interaction was halted because the token budget was exceeded.
-
queuedThe interaction is queued, waiting for processing.
steps array (Step) (optional)
Output only. The steps that make up the interaction, when included in the response.
Possible Types
CodeExecutionCallStep
Code execution call step.
arguments CodeExecutionCallStepArguments (required)
Required. The arguments to pass to the code execution.
Fields
The code to be executed.
Programming language of the `code`.
Possible values:
-
pythonPython >= 3.10, with numpy and simpy available.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_call".
CodeExecutionResultStep
Code execution result step.
Required. ID to match the ID from the function call block.
Whether the code execution resulted in an error.
Required. The output of the code execution.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_result".
FileSearchCallStep
File Search call step.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "file_search_call".
FileSearchResultStep
File Search result step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "file_search_result".
FunctionCallStep
A function tool call step.
Required. The arguments to pass to the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool to call.
No description provided.
Always set to "function_call".
FunctionResultStep
Result of a function tool call.
Required. ID to match the ID from the function call block.
Whether the tool call resulted in an error.
The name of the tool that was called.
Required. The result of the tool call.
No description provided.
Always set to "function_result".
GoogleMapsCallStep
Google Maps call step.
arguments GoogleMapsCallStepArguments (optional)
The arguments to pass to the Google Maps tool.
Fields
The queries to be executed.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_call".
GoogleMapsResultStep
Google Maps result step.
Required. ID to match the ID from the function call block.
result array (GoogleMapsResultItem) (required)
No description provided.
Fields
places array (GoogleMapsResultPlaces) (optional)
No description provided.
Fields
No description provided.
No description provided.
review_snippets array (ReviewSnippet) (optional)
No description provided.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
No description provided.
No description provided.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_result".
GoogleSearchCallStep
Google Search call step.
arguments GoogleSearchCallStepArguments (required)
Required. The arguments to pass to Google Search.
Fields
Web search queries for the following-up web search.
Required. A unique ID for this specific tool call.
The type of search grounding enabled.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
A signature hash for backend validation.
No description provided.
Always set to "google_search_call".
GoogleSearchResultStep
Google Search result step.
Required. ID to match the ID from the function call block.
Whether the Google Search resulted in an error.
result array (GoogleSearchResultItem) (required)
Required. The results of the Google Search.
Fields
Web content snippet that can be embedded in a web page or an app webview.
A signature hash for backend validation.
No description provided.
Always set to "google_search_result".
McpServerToolCallStep
MCPServer tool call step.
Required. The JSON object of arguments for the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool which was called.
Required. The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_call".
McpServerToolResultStep
MCPServer tool result step.
Required. ID to match the ID from the function call block.
Name of the tool which is called for this specific tool call.
Required. The output from the MCP server call. Can be simple text or rich content.
The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_result".
ModelOutputStep
Output generated by the model.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "model_output".
ProcessingCallStep
A server-initiated processing step for media analysis (e.g. video understanding).
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "processing_call".
ProcessingResultStep
The result of a server-initiated media processing step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "processing_result".
ThoughtStep
A thought step.
A signature hash for backend validation.
summary array (ThoughtSummaryContent) (optional)
A summary of the thought.
Possible Types
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
No description provided.
Always set to "thought".
UrlContextCallStep
URL context call step.
arguments UrlContextCallArguments (required)
Required. The arguments to pass to the URL context.
Fields
The URLs to fetch.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "url_context_call".
UrlContextResultStep
URL context result step.
Required. ID to match the ID from the function call block.
Whether the URL context resulted in an error.
result array (UrlContextResult) (required)
Required. The results of the URL context.
Fields
The status of the URL retrieval.
Possible values:
-
successUrl retrieval is successful.
-
errorUrl retrieval is failed due to error.
-
paywallUrl retrieval is failed because the content is behind paywall.
-
unsafeUrl retrieval is failed because the content is unsafe.
The URL that was fetched.
A signature hash for backend validation.
No description provided.
Always set to "url_context_result".
UserInputStep
Input provided by the user.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "user_input".
System instruction for the interaction.
tools array (Tool) (optional)
A list of tool declarations the model may call during interaction.
Possible Types
CodeExecution
A tool that can be used by the model to execute code.
No description provided.
Always set to "code_execution".
ComputerUse
A tool that can be used by the model to interact with the computer.
Optional. Disabled safety policies for computer use.
Possible values:
-
financial_transactionsSafety policy for financial transactions.
-
sensitive_data_modificationSafety policy for sensitive data modification.
-
communication_toolSafety policy for communication tools (e.g. Gmail, Chat, Meet).
-
account_creationSafety policy for account creation.
-
data_modificationSafety policy for data modification.
-
user_consent_managementSafety policy for user consent management.
-
legal_terms_and_agreementsSafety policy for legal terms and agreements.
Whether enable the prompt injection detection check on computer-use request.
The environment being operated.
Possible values:
-
browserOperates in a web browser.
-
mobileOperates in a mobile environment.
-
desktopOperates in a desktop environment.
The list of predefined functions that are excluded from the model call.
No description provided.
Always set to "computer_use".
FileSearch
A tool that can be used by the model to search files.
The file search store names to search.
Metadata filter to apply to the semantic retrieval documents and chunks.
The number of semantic retrieval chunks to retrieve.
No description provided.
Always set to "file_search".
Function
A tool that can be used by the model.
A description of the function.
The name of the function.
The JSON Schema for the function's parameters.
No description provided.
Always set to "function".
GoogleMaps
A tool that can be used by the model to call Google Maps.
Whether to return a widget context token in the tool call result of the response.
The latitude of the user's location.
The longitude of the user's location.
No description provided.
Always set to "google_maps".
GoogleSearch
A tool that can be used by the model to search Google.
The types of search grounding to enable.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
No description provided.
Always set to "google_search".
McpServer
A MCPServer is a server that can be called by the model to perform actions.
allowed_tools array (AllowedTools) (optional)
The allowed tools.
Fields
The mode of the tool choice.
Possible values:
-
autoAuto tool choice.
-
anyAny tool choice.
-
noneNo tool choice.
-
validatedValidated tool choice.
The names of the allowed tools.
Optional: Fields for authentication headers, timeouts, etc., if needed.
The name of the MCPServer.
No description provided.
Always set to "mcp_server".
The full URL for the MCPServer endpoint. Example: "https://api.example.com/mcp"
UrlContext
A tool that can be used by the model to fetch URL context.
No description provided.
Always set to "url_context".
Output only. The time at which the response was last updated in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
usage Usage (optional)
Output only. Statistics on the interaction request's token usage.
Fields
cached_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of cached token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
grounding_tool_count array (GroundingToolCount) (optional)
Grounding tool count.
Fields
The number of grounding tool counts.
The grounding tool type associated with the count.
Possible values:
-
google_searchGrounding with Google Web Search and Image Search, & Web Grounding for Enterprise.
-
google_mapsGrounding with Google Maps.
input_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of input token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
output_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of output token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
tool_use_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of tool-use token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
Number of tokens in the cached part of the prompt (the cached content).
Number of tokens in the prompt (context).
Total number of tokens across all the generated responses.
Number of tokens of thoughts for thinking models.
Total token count for the interaction request (prompt + responses + other internal tokens).
Number of tokens present in tool-use prompt(s).
webhook_config WebhookConfig (optional)
Optional. Webhook configuration for receiving notifications when the interaction completes.
Fields
Optional. If set, these webhook URIs will be used for webhook events instead of the registered webhooks.
Optional. The user metadata that will be returned on each event emission to the webhooks.
Output only. The time when the trigger was last paused.
Output only. The time when the trigger was last resumed.
Output only. The time when the trigger was last run.
Optional. The maximum number of consecutive failures allowed before the trigger is automatically paused (status becomes ERROR).
Output only. The time when the trigger is scheduled to run next.
Output only. The ID of the last interaction created by this trigger.
Required. The cron schedule on which the trigger should run. Standard cron format.
Output only. The current status of the trigger.
Possible values:
-
activeThe trigger is active and will fire on schedule.
-
pausedThe trigger is paused and will not fire.
-
errorThe trigger has entered an error state due to consecutive failures.
Required. Time zone in which the schedule should be interpreted.
Output only. The time when the trigger was last updated.
Example
Example Response
{ "consecutive_failure_count": 0, "create_time": "string", "display_name": "string", "environment_id": "string", "execution_timeout_seconds": 0, "id": "string", "interaction": { "created": "2025-12-04T15:01:45Z", "id": "v1_ChdXS0l4YWZXTk9xbk0xZThQczhEcmlROBIXV0tJeGFmV05PcW5NMWU4UHM4RHJpUTg", "model": "gemini-3.6-flash", "object": "interaction", "status": "completed", "steps": [ { "type": "model_output", "content": [ { "type": "text", "text": "Hello! I'm doing well, functioning as expected. Thank you for asking! How are you doing today?" } ] } ], "updated": "2025-12-04T15:01:45Z", "usage": { "input_tokens_by_modality": [ { "modality": "text", "tokens": 7 } ], "total_cached_tokens": 0, "total_input_tokens": 7, "total_output_tokens": 23, "total_thought_tokens": 49, "total_tokens": 79, "total_tool_use_tokens": 0 } }, "last_pause_time": "string", "last_resume_time": "string", "last_run_time": "string", "max_consecutive_failures": 0, "next_run_time": "string", "previous_interaction_id": "string", "schedule": "string", "status": "active", "time_zone": "string", "update_time": "string" }
RunTrigger
Runs a trigger immediately.
Response
If successful, the response body contains data with the following structure:
Output only. The time when the execution finished.
Output only. The environment ID used for the execution.
Output only. The error message if the execution failed.
Required. Output only. Identifier. The ID of the trigger execution.
Output only. The ID of the interaction created by this execution, if any.
Output only. The time when the execution was scheduled to run.
Output only. The time when the execution started.
Output only. The status of the execution.
Possible values:
-
in_progressThe execution is currently in progress.
-
completedThe execution completed successfully.
-
failedThe execution failed.
-
skippedThe execution was skipped (e.g., previous execution still running).
-
timed_outThe execution timed out.
Required. Output only. Identifier. The ID of the trigger that created this execution.
Example
Example Response
{ "end_time": "string", "environment_id": "string", "error": "string", "id": "string", "interaction_id": "string", "scheduled_time": "string", "start_time": "string", "status": "in_progress", "trigger_id": "string" }
ListTriggers
Lists triggers for a project.
Path / Query Parameters
Optional. Filter expression (e.g., by state).
Optional. The maximum number of triggers to return per page.
Optional. A page token from a previous ListTriggers call.
Response
If successful, the response body contains data with the following structure:
A page token, received from a previous `ListTriggers` call. Provide this to retrieve the subsequent page.
The list of triggers.
Example
Example Response
{ "next_page_token": "string", "triggers": [ { "consecutive_failure_count": 0, "create_time": "string", "display_name": "string", "environment_id": "string", "execution_timeout_seconds": 0, "id": "string", "interaction": { "created": "2025-12-04T15:01:45Z", "id": "v1_ChdXS0l4YWZXTk9xbk0xZThQczhEcmlROBIXV0tJeGFmV05PcW5NMWU4UHM4RHJpUTg", "model": "gemini-3.6-flash", "object": "interaction", "status": "completed", "steps": [ { "type": "model_output", "content": [ { "type": "text", "text": "Hello! I'm doing well, functioning as expected. Thank you for asking! How are you doing today?" } ] } ], "updated": "2025-12-04T15:01:45Z", "usage": { "input_tokens_by_modality": [ { "modality": "text", "tokens": 7 } ], "total_cached_tokens": 0, "total_input_tokens": 7, "total_output_tokens": 23, "total_thought_tokens": 49, "total_tokens": 79, "total_tool_use_tokens": 0 } }, "last_pause_time": "string", "last_resume_time": "string", "last_run_time": "string", "max_consecutive_failures": 0, "next_run_time": "string", "previous_interaction_id": "string", "schedule": "string", "status": "active", "time_zone": "string", "update_time": "string" } ] }
GetTrigger
Gets details of a single trigger.
Response
If successful, the response body contains data with the following structure:
Output only. The number of consecutive failures that have occurred since the last successful execution.
Output only. The time when the trigger was created.
Optional. The display name of the trigger.
Optional. The environment ID for the trigger execution.
Optional. The execution timeout for the triggered interaction.
Required. Output only. Identifier. The ID of the trigger.
interaction Interaction (optional)
Required. The interaction request template to be executed.
Fields
agent AgentOption (optional)
The name of the `Agent` used for generating the interaction.
Possible values
-
deep-research-pro-preview-12-2025Gemini Deep Research Agent
-
deep-research-preview-04-2026Gemini Deep Research Agent
-
deep-research-max-preview-04-2026Gemini Deep Research Max Agent
-
antigravity-preview-05-2026Use the Antigravity managed agent to perform multi-step tasks that require reasoning, file operations, and tool use.
agent_config object (optional)
Configuration parameters for the agent interaction.
Possible Types
Polymorphic discriminator: type
AntigravityAgentConfig
Configuration for the Antigravity agent runtime. Provides server-side control over the agent's execution environment and tool configuration.
Max total tokens for the agent run.
The model to use for agent reasoning.
No description provided.
Always set to "antigravity".
DeepResearchAgentConfig
Configuration for the Deep Research agent.
Enables human-in-the-loop planning for the Deep Research agent. If set to true, the Deep Research agent will provide a research plan in its response. The agent will then proceed only if the user confirms the plan in the next turn.
thinking_summaries ThinkingSummaries (optional)
Whether to include thought summaries in the response.
Possible values
-
autoAuto thinking summaries.
-
noneNo thinking summaries.
No description provided.
Always set to "deep-research".
Whether to include visualizations in the response.
Possible values:
-
offDo not include visualizations.
-
autoAutomatically include visualizations.
DynamicAgentConfig
Configuration for dynamic agents.
No description provided.
Always set to "dynamic".
Output only. The time at which the response was created in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
environment EnvironmentConfig or string (optional)
The environment configuration for the interaction. Can be an object specifying remote environment sources or a string referencing an existing environment ID.
Fields
Optional. The environment ID for the interaction. If specified, the request will update the existing environment instead of creating a new one.
network EnvironmentNetworkEgressAllowlist or enum (string) (optional)
Network configuration for the environment.
Possible Types
object
Outbound networking configuration for the sandbox. When specified, restricts which external domains the sandbox can reach. Omit entirely to allow all outbound traffic with no header injection.
allowlist array (AllowlistEntry) (optional)
List of allowed outbound domains. Only requests to listed domains are permitted. Use [{'domain': '*'}] to allow all domains while still injecting headers on specific ones.
Fields
Domain to allow outbound requests to. Supports wildcards (e.g. '*.googleapis.com'). Use '*' to allow all domains.
Headers to inject on all outbound requests matching this domain. Accepts a single dict or a list of dicts. The egress proxy injects these automatically.
string
Turns all network off.
Possible values
-
disabledTurns all network off.
sources array (Source) (optional)
No description provided.
Fields
The inline content if `type` is `INLINE`.
Optional encoding for inline content (e.g. `base64`).
The source of the environment. For Cloud Storage, this is the Cloud Storage path. For GitHub, this is the GitHub path.
Where the source should appear in the environment.
No description provided.
Possible values:
-
gcsA Cloud Storage bucket.
-
inlineInline content.
-
repositoryA generic repository. The protocol prefix in the source URL identifies the provider (e.g., github://, gcs://).
No description provided.
Always set to "remote".
Output only. The environment ID for the interaction. Only populated if environment config is set in the request.
errors array (Error) (optional)
Output only. Diagnostic faults / platform errors recorded on the interaction.
Fields
A URI that identifies the error type.
A human-readable error message.
Required. Output only. A unique identifier for the interaction completion.
Defaults to:
The input for the interaction.
The labels with user-defined metadata for the request.
model ModelOption (optional)
The name of the `Model` used for generating the interaction.
Possible values
-
gemini-2.5-flashOur first hybrid reasoning model which supports a 1M token context window and has thinking budgets.
-
gemini-2.5-proOur state-of-the-art multipurpose model, which excels at coding and complex reasoning tasks.
-
gemma-4-26b-a4b-itGemma 4 26B A4B IT
-
gemma-4-31b-itGemma 4 31B IT
-
gemini-flash-latestLatest release of Gemini Flash
-
gemini-flash-lite-latestLatest release of Gemini Flash-Lite
-
gemini-pro-latestLatest release of Gemini Pro
-
gemini-2.5-flash-liteOur smallest and most cost effective model, built for at scale usage.
-
gemini-2.5-flash-imageOur native image generation model, optimized for speed, flexibility, and contextual understanding. Text input and output is priced the same as 2.5 Flash.
-
gemini-3-flash-previewOur most intelligent model built for speed, combining frontier intelligence with superior search and grounding.
-
gemini-3.1-pro-previewOur latest SOTA reasoning model with unprecedented depth and nuance, and powerful multimodal understanding and coding capabilities.
-
gemini-3.1-pro-preview-customtoolsGemini 3.1 Pro Preview optimized for custom tool usage
-
gemini-3.1-flash-liteOur most cost-efficient model, optimized for high-volume agentic tasks, translation, and simple data processing.
-
gemini-3-pro-imageGemini 3 Pro Image
-
nano-banana-pro-previewGemini 3 Pro Image Preview
-
gemini-3.1-flash-imageGemini 3.1 Flash Image.
-
gemini-3.5-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.6-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.7-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
lyria-3-clip-previewOur low-latency, music generation model optimized for high-fidelity audio clips and precise rhythmic control.
-
lyria-3-pro-previewOur advanced, full-song generative model with deep compositional understanding, optimized for precise structural control and complex transitions across diverse musical styles.
-
gemini-robotics-er-1.6-previewGemini Robotics-ER 1.6 Preview
-
gemini-robotics-er-2-previewGemini Robotics Embodied Reasoning 2 Preview
The ID of the previous interaction, if any.
response_format ResponseFormat or array (ResponseFormat) (optional)
Enforces that the generated response is a JSON object that complies with the JSON schema specified in this field.
Possible Types
AudioResponseFormat
Configuration for audio output format.
Bit rate in bits per second (bps). Only applicable for compressed formats (MP3, Opus).
The delivery mode for the audio output.
Possible values:
-
inlineAudio data is returned inline in the response.
-
uriAudio data is returned as a URI.
The MIME type of the audio output.
Possible values:
-
audio/mp3MP3 audio format.
-
audio/ogg_opusOGG Opus audio format.
-
audio/l16Raw PCM (L16) audio format.
-
audio/wavWAV audio format.
-
audio/alawA-law audio format.
-
audio/mulawMu-law audio format.
Sample rate in Hz.
No description provided.
Always set to "audio".
ImageResponseFormat
Configuration for image output format.
The aspect ratio for the image output.
Possible values:
-
1:11:1 aspect ratio.
-
2:32:3 aspect ratio.
-
3:23:2 aspect ratio.
-
3:43:4 aspect ratio.
-
4:34:3 aspect ratio.
-
4:54:5 aspect ratio.
-
5:45:4 aspect ratio.
-
9:169:16 aspect ratio.
-
16:916:9 aspect ratio.
-
21:921:9 aspect ratio.
-
1:81:8 aspect ratio.
-
8:18:1 aspect ratio.
-
1:41:4 aspect ratio.
-
4:14:1 aspect ratio.
The delivery mode for the image output.
Possible values:
-
inlineImage data is returned inline in the response.
-
uriImage data is returned as a URI.
The size of the image output.
Possible values:
-
512512px image size.
-
1K1K image size.
-
2K2K image size.
-
4K4K image size.
The MIME type of the image output.
Possible values:
-
image/jpegJPEG image format.
No description provided.
Always set to "image".
TextResponseFormat
Configuration for text output format.
The MIME type of the text output.
Possible values:
-
application/jsonJSON output format.
-
text/plainPlain text output format.
The JSON schema that the output should conform to. Only applicable when mime_type is application/json.
No description provided.
Always set to "text".
VideoResponseFormat
Configuration for video output format.
The aspect ratio for the video output.
Possible values:
-
16:916:9 aspect ratio.
-
9:169:16 aspect ratio.
The delivery mode for the video output.
Possible values:
-
inlineVideo data is returned inline in the response.
-
uriVideo data is returned as a URI.
The duration for the video output.
The video output resolution. Defaults to 720p.
Possible values:
-
360p360p resolution.
-
720p720p resolution.
-
1080p1080p resolution.
-
4k4K resolution.
No description provided.
Always set to "video".
Safety settings for the interaction.
service_tier ServiceTier (optional)
The service tier for the interaction.
Possible values
-
flexFlex service tier.
-
standardStandard service tier.
-
priorityPriority service tier.
Required. Output only. The status of the interaction.
Possible values:
-
in_progressThe interaction is in progress.
-
requires_actionThe interaction requires action/input from the user.
-
completedThe interaction is completed.
-
failedThe interaction failed.
-
cancelledThe interaction was cancelled.
-
incompleteThe interaction is completed, but contains incomplete results (e.g. hitting max_tokens).
-
budget_exceededThe interaction was halted because the token budget was exceeded.
-
queuedThe interaction is queued, waiting for processing.
steps array (Step) (optional)
Output only. The steps that make up the interaction, when included in the response.
Possible Types
CodeExecutionCallStep
Code execution call step.
arguments CodeExecutionCallStepArguments (required)
Required. The arguments to pass to the code execution.
Fields
The code to be executed.
Programming language of the `code`.
Possible values:
-
pythonPython >= 3.10, with numpy and simpy available.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_call".
CodeExecutionResultStep
Code execution result step.
Required. ID to match the ID from the function call block.
Whether the code execution resulted in an error.
Required. The output of the code execution.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_result".
FileSearchCallStep
File Search call step.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "file_search_call".
FileSearchResultStep
File Search result step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "file_search_result".
FunctionCallStep
A function tool call step.
Required. The arguments to pass to the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool to call.
No description provided.
Always set to "function_call".
FunctionResultStep
Result of a function tool call.
Required. ID to match the ID from the function call block.
Whether the tool call resulted in an error.
The name of the tool that was called.
Required. The result of the tool call.
No description provided.
Always set to "function_result".
GoogleMapsCallStep
Google Maps call step.
arguments GoogleMapsCallStepArguments (optional)
The arguments to pass to the Google Maps tool.
Fields
The queries to be executed.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_call".
GoogleMapsResultStep
Google Maps result step.
Required. ID to match the ID from the function call block.
result array (GoogleMapsResultItem) (required)
No description provided.
Fields
places array (GoogleMapsResultPlaces) (optional)
No description provided.
Fields
No description provided.
No description provided.
review_snippets array (ReviewSnippet) (optional)
No description provided.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
No description provided.
No description provided.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_result".
GoogleSearchCallStep
Google Search call step.
arguments GoogleSearchCallStepArguments (required)
Required. The arguments to pass to Google Search.
Fields
Web search queries for the following-up web search.
Required. A unique ID for this specific tool call.
The type of search grounding enabled.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
A signature hash for backend validation.
No description provided.
Always set to "google_search_call".
GoogleSearchResultStep
Google Search result step.
Required. ID to match the ID from the function call block.
Whether the Google Search resulted in an error.
result array (GoogleSearchResultItem) (required)
Required. The results of the Google Search.
Fields
Web content snippet that can be embedded in a web page or an app webview.
A signature hash for backend validation.
No description provided.
Always set to "google_search_result".
McpServerToolCallStep
MCPServer tool call step.
Required. The JSON object of arguments for the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool which was called.
Required. The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_call".
McpServerToolResultStep
MCPServer tool result step.
Required. ID to match the ID from the function call block.
Name of the tool which is called for this specific tool call.
Required. The output from the MCP server call. Can be simple text or rich content.
The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_result".
ModelOutputStep
Output generated by the model.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "model_output".
ProcessingCallStep
A server-initiated processing step for media analysis (e.g. video understanding).
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "processing_call".
ProcessingResultStep
The result of a server-initiated media processing step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "processing_result".
ThoughtStep
A thought step.
A signature hash for backend validation.
summary array (ThoughtSummaryContent) (optional)
A summary of the thought.
Possible Types
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
No description provided.
Always set to "thought".
UrlContextCallStep
URL context call step.
arguments UrlContextCallArguments (required)
Required. The arguments to pass to the URL context.
Fields
The URLs to fetch.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "url_context_call".
UrlContextResultStep
URL context result step.
Required. ID to match the ID from the function call block.
Whether the URL context resulted in an error.
result array (UrlContextResult) (required)
Required. The results of the URL context.
Fields
The status of the URL retrieval.
Possible values:
-
successUrl retrieval is successful.
-
errorUrl retrieval is failed due to error.
-
paywallUrl retrieval is failed because the content is behind paywall.
-
unsafeUrl retrieval is failed because the content is unsafe.
The URL that was fetched.
A signature hash for backend validation.
No description provided.
Always set to "url_context_result".
UserInputStep
Input provided by the user.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "user_input".
System instruction for the interaction.
tools array (Tool) (optional)
A list of tool declarations the model may call during interaction.
Possible Types
CodeExecution
A tool that can be used by the model to execute code.
No description provided.
Always set to "code_execution".
ComputerUse
A tool that can be used by the model to interact with the computer.
Optional. Disabled safety policies for computer use.
Possible values:
-
financial_transactionsSafety policy for financial transactions.
-
sensitive_data_modificationSafety policy for sensitive data modification.
-
communication_toolSafety policy for communication tools (e.g. Gmail, Chat, Meet).
-
account_creationSafety policy for account creation.
-
data_modificationSafety policy for data modification.
-
user_consent_managementSafety policy for user consent management.
-
legal_terms_and_agreementsSafety policy for legal terms and agreements.
Whether enable the prompt injection detection check on computer-use request.
The environment being operated.
Possible values:
-
browserOperates in a web browser.
-
mobileOperates in a mobile environment.
-
desktopOperates in a desktop environment.
The list of predefined functions that are excluded from the model call.
No description provided.
Always set to "computer_use".
FileSearch
A tool that can be used by the model to search files.
The file search store names to search.
Metadata filter to apply to the semantic retrieval documents and chunks.
The number of semantic retrieval chunks to retrieve.
No description provided.
Always set to "file_search".
Function
A tool that can be used by the model.
A description of the function.
The name of the function.
The JSON Schema for the function's parameters.
No description provided.
Always set to "function".
GoogleMaps
A tool that can be used by the model to call Google Maps.
Whether to return a widget context token in the tool call result of the response.
The latitude of the user's location.
The longitude of the user's location.
No description provided.
Always set to "google_maps".
GoogleSearch
A tool that can be used by the model to search Google.
The types of search grounding to enable.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
No description provided.
Always set to "google_search".
McpServer
A MCPServer is a server that can be called by the model to perform actions.
allowed_tools array (AllowedTools) (optional)
The allowed tools.
Fields
The mode of the tool choice.
Possible values:
-
autoAuto tool choice.
-
anyAny tool choice.
-
noneNo tool choice.
-
validatedValidated tool choice.
The names of the allowed tools.
Optional: Fields for authentication headers, timeouts, etc., if needed.
The name of the MCPServer.
No description provided.
Always set to "mcp_server".
The full URL for the MCPServer endpoint. Example: "https://api.example.com/mcp"
UrlContext
A tool that can be used by the model to fetch URL context.
No description provided.
Always set to "url_context".
Output only. The time at which the response was last updated in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
usage Usage (optional)
Output only. Statistics on the interaction request's token usage.
Fields
cached_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of cached token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
grounding_tool_count array (GroundingToolCount) (optional)
Grounding tool count.
Fields
The number of grounding tool counts.
The grounding tool type associated with the count.
Possible values:
-
google_searchGrounding with Google Web Search and Image Search, & Web Grounding for Enterprise.
-
google_mapsGrounding with Google Maps.
input_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of input token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
output_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of output token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
tool_use_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of tool-use token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
Number of tokens in the cached part of the prompt (the cached content).
Number of tokens in the prompt (context).
Total number of tokens across all the generated responses.
Number of tokens of thoughts for thinking models.
Total token count for the interaction request (prompt + responses + other internal tokens).
Number of tokens present in tool-use prompt(s).
webhook_config WebhookConfig (optional)
Optional. Webhook configuration for receiving notifications when the interaction completes.
Fields
Optional. If set, these webhook URIs will be used for webhook events instead of the registered webhooks.
Optional. The user metadata that will be returned on each event emission to the webhooks.
Output only. The time when the trigger was last paused.
Output only. The time when the trigger was last resumed.
Output only. The time when the trigger was last run.
Optional. The maximum number of consecutive failures allowed before the trigger is automatically paused (status becomes ERROR).
Output only. The time when the trigger is scheduled to run next.
Output only. The ID of the last interaction created by this trigger.
Required. The cron schedule on which the trigger should run. Standard cron format.
Output only. The current status of the trigger.
Possible values:
-
activeThe trigger is active and will fire on schedule.
-
pausedThe trigger is paused and will not fire.
-
errorThe trigger has entered an error state due to consecutive failures.
Required. Time zone in which the schedule should be interpreted.
Output only. The time when the trigger was last updated.
Example
Example Response
{ "consecutive_failure_count": 0, "create_time": "string", "display_name": "string", "environment_id": "string", "execution_timeout_seconds": 0, "id": "string", "interaction": { "created": "2025-12-04T15:01:45Z", "id": "v1_ChdXS0l4YWZXTk9xbk0xZThQczhEcmlROBIXV0tJeGFmV05PcW5NMWU4UHM4RHJpUTg", "model": "gemini-3.6-flash", "object": "interaction", "status": "completed", "steps": [ { "type": "model_output", "content": [ { "type": "text", "text": "Hello! I'm doing well, functioning as expected. Thank you for asking! How are you doing today?" } ] } ], "updated": "2025-12-04T15:01:45Z", "usage": { "input_tokens_by_modality": [ { "modality": "text", "tokens": 7 } ], "total_cached_tokens": 0, "total_input_tokens": 7, "total_output_tokens": 23, "total_thought_tokens": 49, "total_tokens": 79, "total_tool_use_tokens": 0 } }, "last_pause_time": "string", "last_resume_time": "string", "last_run_time": "string", "max_consecutive_failures": 0, "next_run_time": "string", "previous_interaction_id": "string", "schedule": "string", "status": "active", "time_zone": "string", "update_time": "string" }
ListTriggerExecutions
Lists executions for a trigger.
Path / Query Parameters
Optional. The maximum number of executions to return per page.
Optional. A page token from a previous ListTriggerExecutions call.
Response
If successful, the response body contains data with the following structure:
A page token, received from a previous `ListTriggerExecutions` call. Provide this to retrieve the subsequent page.
trigger_executions array (TriggerExecution) (optional)
The list of trigger executions.
Fields
Output only. The time when the execution finished.
Output only. The environment ID used for the execution.
Output only. The error message if the execution failed.
Required. Output only. Identifier. The ID of the trigger execution.
Output only. The ID of the interaction created by this execution, if any.
Output only. The time when the execution was scheduled to run.
Output only. The time when the execution started.
Output only. The status of the execution.
Possible values:
-
in_progressThe execution is currently in progress.
-
completedThe execution completed successfully.
-
failedThe execution failed.
-
skippedThe execution was skipped (e.g., previous execution still running).
-
timed_outThe execution timed out.
Required. Output only. Identifier. The ID of the trigger that created this execution.
Example
Example Response
{ "next_page_token": "string", "trigger_executions": [ { "end_time": "string", "environment_id": "string", "error": "string", "id": "string", "interaction_id": "string", "scheduled_time": "string", "start_time": "string", "status": "in_progress", "trigger_id": "string" } ] }
UpdateTrigger
Updates a trigger.
Request body
The request body contains data with the following structure:
Optional. The display name of the trigger.
Optional. The status of the trigger.
Possible values:
-
activeThe trigger is active and will fire on schedule.
-
pausedThe trigger is paused and will not fire.
-
errorThe trigger has entered an error state due to consecutive failures.
Response
If successful, the response body contains data with the following structure:
Output only. The number of consecutive failures that have occurred since the last successful execution.
Output only. The time when the trigger was created.
Optional. The display name of the trigger.
Optional. The environment ID for the trigger execution.
Optional. The execution timeout for the triggered interaction.
Required. Output only. Identifier. The ID of the trigger.
interaction Interaction (optional)
Required. The interaction request template to be executed.
Fields
agent AgentOption (optional)
The name of the `Agent` used for generating the interaction.
Possible values
-
deep-research-pro-preview-12-2025Gemini Deep Research Agent
-
deep-research-preview-04-2026Gemini Deep Research Agent
-
deep-research-max-preview-04-2026Gemini Deep Research Max Agent
-
antigravity-preview-05-2026Use the Antigravity managed agent to perform multi-step tasks that require reasoning, file operations, and tool use.
agent_config object (optional)
Configuration parameters for the agent interaction.
Possible Types
Polymorphic discriminator: type
AntigravityAgentConfig
Configuration for the Antigravity agent runtime. Provides server-side control over the agent's execution environment and tool configuration.
Max total tokens for the agent run.
The model to use for agent reasoning.
No description provided.
Always set to "antigravity".
DeepResearchAgentConfig
Configuration for the Deep Research agent.
Enables human-in-the-loop planning for the Deep Research agent. If set to true, the Deep Research agent will provide a research plan in its response. The agent will then proceed only if the user confirms the plan in the next turn.
thinking_summaries ThinkingSummaries (optional)
Whether to include thought summaries in the response.
Possible values
-
autoAuto thinking summaries.
-
noneNo thinking summaries.
No description provided.
Always set to "deep-research".
Whether to include visualizations in the response.
Possible values:
-
offDo not include visualizations.
-
autoAutomatically include visualizations.
DynamicAgentConfig
Configuration for dynamic agents.
No description provided.
Always set to "dynamic".
Output only. The time at which the response was created in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
environment EnvironmentConfig or string (optional)
The environment configuration for the interaction. Can be an object specifying remote environment sources or a string referencing an existing environment ID.
Fields
Optional. The environment ID for the interaction. If specified, the request will update the existing environment instead of creating a new one.
network EnvironmentNetworkEgressAllowlist or enum (string) (optional)
Network configuration for the environment.
Possible Types
object
Outbound networking configuration for the sandbox. When specified, restricts which external domains the sandbox can reach. Omit entirely to allow all outbound traffic with no header injection.
allowlist array (AllowlistEntry) (optional)
List of allowed outbound domains. Only requests to listed domains are permitted. Use [{'domain': '*'}] to allow all domains while still injecting headers on specific ones.
Fields
Domain to allow outbound requests to. Supports wildcards (e.g. '*.googleapis.com'). Use '*' to allow all domains.
Headers to inject on all outbound requests matching this domain. Accepts a single dict or a list of dicts. The egress proxy injects these automatically.
string
Turns all network off.
Possible values
-
disabledTurns all network off.
sources array (Source) (optional)
No description provided.
Fields
The inline content if `type` is `INLINE`.
Optional encoding for inline content (e.g. `base64`).
The source of the environment. For Cloud Storage, this is the Cloud Storage path. For GitHub, this is the GitHub path.
Where the source should appear in the environment.
No description provided.
Possible values:
-
gcsA Cloud Storage bucket.
-
inlineInline content.
-
repositoryA generic repository. The protocol prefix in the source URL identifies the provider (e.g., github://, gcs://).
No description provided.
Always set to "remote".
Output only. The environment ID for the interaction. Only populated if environment config is set in the request.
errors array (Error) (optional)
Output only. Diagnostic faults / platform errors recorded on the interaction.
Fields
A URI that identifies the error type.
A human-readable error message.
Required. Output only. A unique identifier for the interaction completion.
Defaults to:
The input for the interaction.
The labels with user-defined metadata for the request.
model ModelOption (optional)
The name of the `Model` used for generating the interaction.
Possible values
-
gemini-2.5-flashOur first hybrid reasoning model which supports a 1M token context window and has thinking budgets.
-
gemini-2.5-proOur state-of-the-art multipurpose model, which excels at coding and complex reasoning tasks.
-
gemma-4-26b-a4b-itGemma 4 26B A4B IT
-
gemma-4-31b-itGemma 4 31B IT
-
gemini-flash-latestLatest release of Gemini Flash
-
gemini-flash-lite-latestLatest release of Gemini Flash-Lite
-
gemini-pro-latestLatest release of Gemini Pro
-
gemini-2.5-flash-liteOur smallest and most cost effective model, built for at scale usage.
-
gemini-2.5-flash-imageOur native image generation model, optimized for speed, flexibility, and contextual understanding. Text input and output is priced the same as 2.5 Flash.
-
gemini-3-flash-previewOur most intelligent model built for speed, combining frontier intelligence with superior search and grounding.
-
gemini-3.1-pro-previewOur latest SOTA reasoning model with unprecedented depth and nuance, and powerful multimodal understanding and coding capabilities.
-
gemini-3.1-pro-preview-customtoolsGemini 3.1 Pro Preview optimized for custom tool usage
-
gemini-3.1-flash-liteOur most cost-efficient model, optimized for high-volume agentic tasks, translation, and simple data processing.
-
gemini-3-pro-imageGemini 3 Pro Image
-
nano-banana-pro-previewGemini 3 Pro Image Preview
-
gemini-3.1-flash-imageGemini 3.1 Flash Image.
-
gemini-3.5-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.6-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.7-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
lyria-3-clip-previewOur low-latency, music generation model optimized for high-fidelity audio clips and precise rhythmic control.
-
lyria-3-pro-previewOur advanced, full-song generative model with deep compositional understanding, optimized for precise structural control and complex transitions across diverse musical styles.
-
gemini-robotics-er-1.6-previewGemini Robotics-ER 1.6 Preview
-
gemini-robotics-er-2-previewGemini Robotics Embodied Reasoning 2 Preview
The ID of the previous interaction, if any.
response_format ResponseFormat or array (ResponseFormat) (optional)
Enforces that the generated response is a JSON object that complies with the JSON schema specified in this field.
Possible Types
AudioResponseFormat
Configuration for audio output format.
Bit rate in bits per second (bps). Only applicable for compressed formats (MP3, Opus).
The delivery mode for the audio output.
Possible values:
-
inlineAudio data is returned inline in the response.
-
uriAudio data is returned as a URI.
The MIME type of the audio output.
Possible values:
-
audio/mp3MP3 audio format.
-
audio/ogg_opusOGG Opus audio format.
-
audio/l16Raw PCM (L16) audio format.
-
audio/wavWAV audio format.
-
audio/alawA-law audio format.
-
audio/mulawMu-law audio format.
Sample rate in Hz.
No description provided.
Always set to "audio".
ImageResponseFormat
Configuration for image output format.
The aspect ratio for the image output.
Possible values:
-
1:11:1 aspect ratio.
-
2:32:3 aspect ratio.
-
3:23:2 aspect ratio.
-
3:43:4 aspect ratio.
-
4:34:3 aspect ratio.
-
4:54:5 aspect ratio.
-
5:45:4 aspect ratio.
-
9:169:16 aspect ratio.
-
16:916:9 aspect ratio.
-
21:921:9 aspect ratio.
-
1:81:8 aspect ratio.
-
8:18:1 aspect ratio.
-
1:41:4 aspect ratio.
-
4:14:1 aspect ratio.
The delivery mode for the image output.
Possible values:
-
inlineImage data is returned inline in the response.
-
uriImage data is returned as a URI.
The size of the image output.
Possible values:
-
512512px image size.
-
1K1K image size.
-
2K2K image size.
-
4K4K image size.
The MIME type of the image output.
Possible values:
-
image/jpegJPEG image format.
No description provided.
Always set to "image".
TextResponseFormat
Configuration for text output format.
The MIME type of the text output.
Possible values:
-
application/jsonJSON output format.
-
text/plainPlain text output format.
The JSON schema that the output should conform to. Only applicable when mime_type is application/json.
No description provided.
Always set to "text".
VideoResponseFormat
Configuration for video output format.
The aspect ratio for the video output.
Possible values:
-
16:916:9 aspect ratio.
-
9:169:16 aspect ratio.
The delivery mode for the video output.
Possible values:
-
inlineVideo data is returned inline in the response.
-
uriVideo data is returned as a URI.
The duration for the video output.
The video output resolution. Defaults to 720p.
Possible values:
-
360p360p resolution.
-
720p720p resolution.
-
1080p1080p resolution.
-
4k4K resolution.
No description provided.
Always set to "video".
Safety settings for the interaction.
service_tier ServiceTier (optional)
The service tier for the interaction.
Possible values
-
flexFlex service tier.
-
standardStandard service tier.
-
priorityPriority service tier.
Required. Output only. The status of the interaction.
Possible values:
-
in_progressThe interaction is in progress.
-
requires_actionThe interaction requires action/input from the user.
-
completedThe interaction is completed.
-
failedThe interaction failed.
-
cancelledThe interaction was cancelled.
-
incompleteThe interaction is completed, but contains incomplete results (e.g. hitting max_tokens).
-
budget_exceededThe interaction was halted because the token budget was exceeded.
-
queuedThe interaction is queued, waiting for processing.
steps array (Step) (optional)
Output only. The steps that make up the interaction, when included in the response.
Possible Types
CodeExecutionCallStep
Code execution call step.
arguments CodeExecutionCallStepArguments (required)
Required. The arguments to pass to the code execution.
Fields
The code to be executed.
Programming language of the `code`.
Possible values:
-
pythonPython >= 3.10, with numpy and simpy available.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_call".
CodeExecutionResultStep
Code execution result step.
Required. ID to match the ID from the function call block.
Whether the code execution resulted in an error.
Required. The output of the code execution.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_result".
FileSearchCallStep
File Search call step.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "file_search_call".
FileSearchResultStep
File Search result step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "file_search_result".
FunctionCallStep
A function tool call step.
Required. The arguments to pass to the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool to call.
No description provided.
Always set to "function_call".
FunctionResultStep
Result of a function tool call.
Required. ID to match the ID from the function call block.
Whether the tool call resulted in an error.
The name of the tool that was called.
Required. The result of the tool call.
No description provided.
Always set to "function_result".
GoogleMapsCallStep
Google Maps call step.
arguments GoogleMapsCallStepArguments (optional)
The arguments to pass to the Google Maps tool.
Fields
The queries to be executed.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_call".
GoogleMapsResultStep
Google Maps result step.
Required. ID to match the ID from the function call block.
result array (GoogleMapsResultItem) (required)
No description provided.
Fields
places array (GoogleMapsResultPlaces) (optional)
No description provided.
Fields
No description provided.
No description provided.
review_snippets array (ReviewSnippet) (optional)
No description provided.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
No description provided.
No description provided.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_result".
GoogleSearchCallStep
Google Search call step.
arguments GoogleSearchCallStepArguments (required)
Required. The arguments to pass to Google Search.
Fields
Web search queries for the following-up web search.
Required. A unique ID for this specific tool call.
The type of search grounding enabled.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
A signature hash for backend validation.
No description provided.
Always set to "google_search_call".
GoogleSearchResultStep
Google Search result step.
Required. ID to match the ID from the function call block.
Whether the Google Search resulted in an error.
result array (GoogleSearchResultItem) (required)
Required. The results of the Google Search.
Fields
Web content snippet that can be embedded in a web page or an app webview.
A signature hash for backend validation.
No description provided.
Always set to "google_search_result".
McpServerToolCallStep
MCPServer tool call step.
Required. The JSON object of arguments for the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool which was called.
Required. The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_call".
McpServerToolResultStep
MCPServer tool result step.
Required. ID to match the ID from the function call block.
Name of the tool which is called for this specific tool call.
Required. The output from the MCP server call. Can be simple text or rich content.
The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_result".
ModelOutputStep
Output generated by the model.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "model_output".
ProcessingCallStep
A server-initiated processing step for media analysis (e.g. video understanding).
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "processing_call".
ProcessingResultStep
The result of a server-initiated media processing step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "processing_result".
ThoughtStep
A thought step.
A signature hash for backend validation.
summary array (ThoughtSummaryContent) (optional)
A summary of the thought.
Possible Types
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
No description provided.
Always set to "thought".
UrlContextCallStep
URL context call step.
arguments UrlContextCallArguments (required)
Required. The arguments to pass to the URL context.
Fields
The URLs to fetch.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "url_context_call".
UrlContextResultStep
URL context result step.
Required. ID to match the ID from the function call block.
Whether the URL context resulted in an error.
result array (UrlContextResult) (required)
Required. The results of the URL context.
Fields
The status of the URL retrieval.
Possible values:
-
successUrl retrieval is successful.
-
errorUrl retrieval is failed due to error.
-
paywallUrl retrieval is failed because the content is behind paywall.
-
unsafeUrl retrieval is failed because the content is unsafe.
The URL that was fetched.
A signature hash for backend validation.
No description provided.
Always set to "url_context_result".
UserInputStep
Input provided by the user.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "user_input".
System instruction for the interaction.
tools array (Tool) (optional)
A list of tool declarations the model may call during interaction.
Possible Types
CodeExecution
A tool that can be used by the model to execute code.
No description provided.
Always set to "code_execution".
ComputerUse
A tool that can be used by the model to interact with the computer.
Optional. Disabled safety policies for computer use.
Possible values:
-
financial_transactionsSafety policy for financial transactions.
-
sensitive_data_modificationSafety policy for sensitive data modification.
-
communication_toolSafety policy for communication tools (e.g. Gmail, Chat, Meet).
-
account_creationSafety policy for account creation.
-
data_modificationSafety policy for data modification.
-
user_consent_managementSafety policy for user consent management.
-
legal_terms_and_agreementsSafety policy for legal terms and agreements.
Whether enable the prompt injection detection check on computer-use request.
The environment being operated.
Possible values:
-
browserOperates in a web browser.
-
mobileOperates in a mobile environment.
-
desktopOperates in a desktop environment.
The list of predefined functions that are excluded from the model call.
No description provided.
Always set to "computer_use".
FileSearch
A tool that can be used by the model to search files.
The file search store names to search.
Metadata filter to apply to the semantic retrieval documents and chunks.
The number of semantic retrieval chunks to retrieve.
No description provided.
Always set to "file_search".
Function
A tool that can be used by the model.
A description of the function.
The name of the function.
The JSON Schema for the function's parameters.
No description provided.
Always set to "function".
GoogleMaps
A tool that can be used by the model to call Google Maps.
Whether to return a widget context token in the tool call result of the response.
The latitude of the user's location.
The longitude of the user's location.
No description provided.
Always set to "google_maps".
GoogleSearch
A tool that can be used by the model to search Google.
The types of search grounding to enable.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
No description provided.
Always set to "google_search".
McpServer
A MCPServer is a server that can be called by the model to perform actions.
allowed_tools array (AllowedTools) (optional)
The allowed tools.
Fields
The mode of the tool choice.
Possible values:
-
autoAuto tool choice.
-
anyAny tool choice.
-
noneNo tool choice.
-
validatedValidated tool choice.
The names of the allowed tools.
Optional: Fields for authentication headers, timeouts, etc., if needed.
The name of the MCPServer.
No description provided.
Always set to "mcp_server".
The full URL for the MCPServer endpoint. Example: "https://api.example.com/mcp"
UrlContext
A tool that can be used by the model to fetch URL context.
No description provided.
Always set to "url_context".
Output only. The time at which the response was last updated in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
usage Usage (optional)
Output only. Statistics on the interaction request's token usage.
Fields
cached_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of cached token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
grounding_tool_count array (GroundingToolCount) (optional)
Grounding tool count.
Fields
The number of grounding tool counts.
The grounding tool type associated with the count.
Possible values:
-
google_searchGrounding with Google Web Search and Image Search, & Web Grounding for Enterprise.
-
google_mapsGrounding with Google Maps.
input_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of input token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
output_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of output token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
tool_use_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of tool-use token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
Number of tokens in the cached part of the prompt (the cached content).
Number of tokens in the prompt (context).
Total number of tokens across all the generated responses.
Number of tokens of thoughts for thinking models.
Total token count for the interaction request (prompt + responses + other internal tokens).
Number of tokens present in tool-use prompt(s).
webhook_config WebhookConfig (optional)
Optional. Webhook configuration for receiving notifications when the interaction completes.
Fields
Optional. If set, these webhook URIs will be used for webhook events instead of the registered webhooks.
Optional. The user metadata that will be returned on each event emission to the webhooks.
Output only. The time when the trigger was last paused.
Output only. The time when the trigger was last resumed.
Output only. The time when the trigger was last run.
Optional. The maximum number of consecutive failures allowed before the trigger is automatically paused (status becomes ERROR).
Output only. The time when the trigger is scheduled to run next.
Output only. The ID of the last interaction created by this trigger.
Required. The cron schedule on which the trigger should run. Standard cron format.
Output only. The current status of the trigger.
Possible values:
-
activeThe trigger is active and will fire on schedule.
-
pausedThe trigger is paused and will not fire.
-
errorThe trigger has entered an error state due to consecutive failures.
Required. Time zone in which the schedule should be interpreted.
Output only. The time when the trigger was last updated.
Example
Example Response
{ "consecutive_failure_count": 0, "create_time": "string", "display_name": "string", "environment_id": "string", "execution_timeout_seconds": 0, "id": "string", "interaction": { "created": "2025-12-04T15:01:45Z", "id": "v1_ChdXS0l4YWZXTk9xbk0xZThQczhEcmlROBIXV0tJeGFmV05PcW5NMWU4UHM4RHJpUTg", "model": "gemini-3.6-flash", "object": "interaction", "status": "completed", "steps": [ { "type": "model_output", "content": [ { "type": "text", "text": "Hello! I'm doing well, functioning as expected. Thank you for asking! How are you doing today?" } ] } ], "updated": "2025-12-04T15:01:45Z", "usage": { "input_tokens_by_modality": [ { "modality": "text", "tokens": 7 } ], "total_cached_tokens": 0, "total_input_tokens": 7, "total_output_tokens": 23, "total_thought_tokens": 49, "total_tokens": 79, "total_tool_use_tokens": 0 } }, "last_pause_time": "string", "last_resume_time": "string", "last_run_time": "string", "max_consecutive_failures": 0, "next_run_time": "string", "previous_interaction_id": "string", "schedule": "string", "status": "active", "time_zone": "string", "update_time": "string" }
DeleteTrigger
Deletes a trigger.
Response
If successful, the response is empty.
Example
Resources
Trigger
A trigger configuration that is scheduled to run an agent.
Fields
Output only. The number of consecutive failures that have occurred since the last successful execution.
Output only. The time when the trigger was created.
Optional. The display name of the trigger.
Optional. The environment ID for the trigger execution.
Optional. The execution timeout for the triggered interaction.
Required. Output only. Identifier. The ID of the trigger.
interaction Interaction (optional)
Required. The interaction request template to be executed.
Fields
agent AgentOption (optional)
The name of the `Agent` used for generating the interaction.
Possible values
-
deep-research-pro-preview-12-2025Gemini Deep Research Agent
-
deep-research-preview-04-2026Gemini Deep Research Agent
-
deep-research-max-preview-04-2026Gemini Deep Research Max Agent
-
antigravity-preview-05-2026Use the Antigravity managed agent to perform multi-step tasks that require reasoning, file operations, and tool use.
agent_config object (optional)
Configuration parameters for the agent interaction.
Possible Types
Polymorphic discriminator: type
AntigravityAgentConfig
Configuration for the Antigravity agent runtime. Provides server-side control over the agent's execution environment and tool configuration.
Max total tokens for the agent run.
The model to use for agent reasoning.
No description provided.
Always set to "antigravity".
DeepResearchAgentConfig
Configuration for the Deep Research agent.
Enables human-in-the-loop planning for the Deep Research agent. If set to true, the Deep Research agent will provide a research plan in its response. The agent will then proceed only if the user confirms the plan in the next turn.
thinking_summaries ThinkingSummaries (optional)
Whether to include thought summaries in the response.
Possible values
-
autoAuto thinking summaries.
-
noneNo thinking summaries.
No description provided.
Always set to "deep-research".
Whether to include visualizations in the response.
Possible values:
-
offDo not include visualizations.
-
autoAutomatically include visualizations.
DynamicAgentConfig
Configuration for dynamic agents.
No description provided.
Always set to "dynamic".
Output only. The time at which the response was created in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
environment EnvironmentConfig or string (optional)
The environment configuration for the interaction. Can be an object specifying remote environment sources or a string referencing an existing environment ID.
Fields
Optional. The environment ID for the interaction. If specified, the request will update the existing environment instead of creating a new one.
network EnvironmentNetworkEgressAllowlist or enum (string) (optional)
Network configuration for the environment.
Possible Types
object
Outbound networking configuration for the sandbox. When specified, restricts which external domains the sandbox can reach. Omit entirely to allow all outbound traffic with no header injection.
allowlist array (AllowlistEntry) (optional)
List of allowed outbound domains. Only requests to listed domains are permitted. Use [{'domain': '*'}] to allow all domains while still injecting headers on specific ones.
Fields
Domain to allow outbound requests to. Supports wildcards (e.g. '*.googleapis.com'). Use '*' to allow all domains.
Headers to inject on all outbound requests matching this domain. Accepts a single dict or a list of dicts. The egress proxy injects these automatically.
string
Turns all network off.
Possible values
-
disabledTurns all network off.
sources array (Source) (optional)
No description provided.
Fields
The inline content if `type` is `INLINE`.
Optional encoding for inline content (e.g. `base64`).
The source of the environment. For Cloud Storage, this is the Cloud Storage path. For GitHub, this is the GitHub path.
Where the source should appear in the environment.
No description provided.
Possible values:
-
gcsA Cloud Storage bucket.
-
inlineInline content.
-
repositoryA generic repository. The protocol prefix in the source URL identifies the provider (e.g., github://, gcs://).
No description provided.
Always set to "remote".
Output only. The environment ID for the interaction. Only populated if environment config is set in the request.
errors array (Error) (optional)
Output only. Diagnostic faults / platform errors recorded on the interaction.
Fields
A URI that identifies the error type.
A human-readable error message.
Required. Output only. A unique identifier for the interaction completion.
Defaults to:
The input for the interaction.
The labels with user-defined metadata for the request.
model ModelOption (optional)
The name of the `Model` used for generating the interaction.
Possible values
-
gemini-2.5-flashOur first hybrid reasoning model which supports a 1M token context window and has thinking budgets.
-
gemini-2.5-proOur state-of-the-art multipurpose model, which excels at coding and complex reasoning tasks.
-
gemma-4-26b-a4b-itGemma 4 26B A4B IT
-
gemma-4-31b-itGemma 4 31B IT
-
gemini-flash-latestLatest release of Gemini Flash
-
gemini-flash-lite-latestLatest release of Gemini Flash-Lite
-
gemini-pro-latestLatest release of Gemini Pro
-
gemini-2.5-flash-liteOur smallest and most cost effective model, built for at scale usage.
-
gemini-2.5-flash-imageOur native image generation model, optimized for speed, flexibility, and contextual understanding. Text input and output is priced the same as 2.5 Flash.
-
gemini-3-flash-previewOur most intelligent model built for speed, combining frontier intelligence with superior search and grounding.
-
gemini-3.1-pro-previewOur latest SOTA reasoning model with unprecedented depth and nuance, and powerful multimodal understanding and coding capabilities.
-
gemini-3.1-pro-preview-customtoolsGemini 3.1 Pro Preview optimized for custom tool usage
-
gemini-3.1-flash-liteOur most cost-efficient model, optimized for high-volume agentic tasks, translation, and simple data processing.
-
gemini-3-pro-imageGemini 3 Pro Image
-
nano-banana-pro-previewGemini 3 Pro Image Preview
-
gemini-3.1-flash-imageGemini 3.1 Flash Image.
-
gemini-3.5-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.6-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
gemini-3.7-flashOur most intelligent model for sustained frontier performance in agentic and coding tasks.
-
lyria-3-clip-previewOur low-latency, music generation model optimized for high-fidelity audio clips and precise rhythmic control.
-
lyria-3-pro-previewOur advanced, full-song generative model with deep compositional understanding, optimized for precise structural control and complex transitions across diverse musical styles.
-
gemini-robotics-er-1.6-previewGemini Robotics-ER 1.6 Preview
-
gemini-robotics-er-2-previewGemini Robotics Embodied Reasoning 2 Preview
The ID of the previous interaction, if any.
response_format ResponseFormat or array (ResponseFormat) (optional)
Enforces that the generated response is a JSON object that complies with the JSON schema specified in this field.
Possible Types
AudioResponseFormat
Configuration for audio output format.
Bit rate in bits per second (bps). Only applicable for compressed formats (MP3, Opus).
The delivery mode for the audio output.
Possible values:
-
inlineAudio data is returned inline in the response.
-
uriAudio data is returned as a URI.
The MIME type of the audio output.
Possible values:
-
audio/mp3MP3 audio format.
-
audio/ogg_opusOGG Opus audio format.
-
audio/l16Raw PCM (L16) audio format.
-
audio/wavWAV audio format.
-
audio/alawA-law audio format.
-
audio/mulawMu-law audio format.
Sample rate in Hz.
No description provided.
Always set to "audio".
ImageResponseFormat
Configuration for image output format.
The aspect ratio for the image output.
Possible values:
-
1:11:1 aspect ratio.
-
2:32:3 aspect ratio.
-
3:23:2 aspect ratio.
-
3:43:4 aspect ratio.
-
4:34:3 aspect ratio.
-
4:54:5 aspect ratio.
-
5:45:4 aspect ratio.
-
9:169:16 aspect ratio.
-
16:916:9 aspect ratio.
-
21:921:9 aspect ratio.
-
1:81:8 aspect ratio.
-
8:18:1 aspect ratio.
-
1:41:4 aspect ratio.
-
4:14:1 aspect ratio.
The delivery mode for the image output.
Possible values:
-
inlineImage data is returned inline in the response.
-
uriImage data is returned as a URI.
The size of the image output.
Possible values:
-
512512px image size.
-
1K1K image size.
-
2K2K image size.
-
4K4K image size.
The MIME type of the image output.
Possible values:
-
image/jpegJPEG image format.
No description provided.
Always set to "image".
TextResponseFormat
Configuration for text output format.
The MIME type of the text output.
Possible values:
-
application/jsonJSON output format.
-
text/plainPlain text output format.
The JSON schema that the output should conform to. Only applicable when mime_type is application/json.
No description provided.
Always set to "text".
VideoResponseFormat
Configuration for video output format.
The aspect ratio for the video output.
Possible values:
-
16:916:9 aspect ratio.
-
9:169:16 aspect ratio.
The delivery mode for the video output.
Possible values:
-
inlineVideo data is returned inline in the response.
-
uriVideo data is returned as a URI.
The duration for the video output.
The video output resolution. Defaults to 720p.
Possible values:
-
360p360p resolution.
-
720p720p resolution.
-
1080p1080p resolution.
-
4k4K resolution.
No description provided.
Always set to "video".
Safety settings for the interaction.
service_tier ServiceTier (optional)
The service tier for the interaction.
Possible values
-
flexFlex service tier.
-
standardStandard service tier.
-
priorityPriority service tier.
Required. Output only. The status of the interaction.
Possible values:
-
in_progressThe interaction is in progress.
-
requires_actionThe interaction requires action/input from the user.
-
completedThe interaction is completed.
-
failedThe interaction failed.
-
cancelledThe interaction was cancelled.
-
incompleteThe interaction is completed, but contains incomplete results (e.g. hitting max_tokens).
-
budget_exceededThe interaction was halted because the token budget was exceeded.
-
queuedThe interaction is queued, waiting for processing.
steps array (Step) (optional)
Output only. The steps that make up the interaction, when included in the response.
Possible Types
CodeExecutionCallStep
Code execution call step.
arguments CodeExecutionCallStepArguments (required)
Required. The arguments to pass to the code execution.
Fields
The code to be executed.
Programming language of the `code`.
Possible values:
-
pythonPython >= 3.10, with numpy and simpy available.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_call".
CodeExecutionResultStep
Code execution result step.
Required. ID to match the ID from the function call block.
Whether the code execution resulted in an error.
Required. The output of the code execution.
A signature hash for backend validation.
No description provided.
Always set to "code_execution_result".
FileSearchCallStep
File Search call step.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "file_search_call".
FileSearchResultStep
File Search result step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "file_search_result".
FunctionCallStep
A function tool call step.
Required. The arguments to pass to the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool to call.
No description provided.
Always set to "function_call".
FunctionResultStep
Result of a function tool call.
Required. ID to match the ID from the function call block.
Whether the tool call resulted in an error.
The name of the tool that was called.
Required. The result of the tool call.
No description provided.
Always set to "function_result".
GoogleMapsCallStep
Google Maps call step.
arguments GoogleMapsCallStepArguments (optional)
The arguments to pass to the Google Maps tool.
Fields
The queries to be executed.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_call".
GoogleMapsResultStep
Google Maps result step.
Required. ID to match the ID from the function call block.
result array (GoogleMapsResultItem) (required)
No description provided.
Fields
places array (GoogleMapsResultPlaces) (optional)
No description provided.
Fields
No description provided.
No description provided.
review_snippets array (ReviewSnippet) (optional)
No description provided.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
No description provided.
No description provided.
A signature hash for backend validation.
No description provided.
Always set to "google_maps_result".
GoogleSearchCallStep
Google Search call step.
arguments GoogleSearchCallStepArguments (required)
Required. The arguments to pass to Google Search.
Fields
Web search queries for the following-up web search.
Required. A unique ID for this specific tool call.
The type of search grounding enabled.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
A signature hash for backend validation.
No description provided.
Always set to "google_search_call".
GoogleSearchResultStep
Google Search result step.
Required. ID to match the ID from the function call block.
Whether the Google Search resulted in an error.
result array (GoogleSearchResultItem) (required)
Required. The results of the Google Search.
Fields
Web content snippet that can be embedded in a web page or an app webview.
A signature hash for backend validation.
No description provided.
Always set to "google_search_result".
McpServerToolCallStep
MCPServer tool call step.
Required. The JSON object of arguments for the function.
Required. A unique ID for this specific tool call.
Required. The name of the tool which was called.
Required. The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_call".
McpServerToolResultStep
MCPServer tool result step.
Required. ID to match the ID from the function call block.
Name of the tool which is called for this specific tool call.
Required. The output from the MCP server call. Can be simple text or rich content.
The name of the used MCP server.
No description provided.
Always set to "mcp_server_tool_result".
ModelOutputStep
Output generated by the model.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "model_output".
ProcessingCallStep
A server-initiated processing step for media analysis (e.g. video understanding).
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "processing_call".
ProcessingResultStep
The result of a server-initiated media processing step.
Required. ID to match the ID from the function call block.
A signature hash for backend validation.
No description provided.
Always set to "processing_result".
ThoughtStep
A thought step.
A signature hash for backend validation.
summary array (ThoughtSummaryContent) (optional)
A summary of the thought.
Possible Types
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
No description provided.
Always set to "thought".
UrlContextCallStep
URL context call step.
arguments UrlContextCallArguments (required)
Required. The arguments to pass to the URL context.
Fields
The URLs to fetch.
Required. A unique ID for this specific tool call.
A signature hash for backend validation.
No description provided.
Always set to "url_context_call".
UrlContextResultStep
URL context result step.
Required. ID to match the ID from the function call block.
Whether the URL context resulted in an error.
result array (UrlContextResult) (required)
Required. The results of the URL context.
Fields
The status of the URL retrieval.
Possible values:
-
successUrl retrieval is successful.
-
errorUrl retrieval is failed due to error.
-
paywallUrl retrieval is failed because the content is behind paywall.
-
unsafeUrl retrieval is failed because the content is unsafe.
The URL that was fetched.
A signature hash for backend validation.
No description provided.
Always set to "url_context_result".
UserInputStep
Input provided by the user.
content array (Content) (optional)
No description provided.
Possible Types
AudioContent
An audio content block.
The number of audio channels.
The audio content.
The mime type of the audio.
Possible values:
-
audio/wavWAV audio format
-
audio/mp3MP3 audio format
-
audio/aiffAIFF audio format
-
audio/aacAAC audio format
-
audio/oggOGG audio format
-
audio/flacFLAC audio format
-
audio/mpegMPEG audio format
-
audio/m4aM4A audio format
-
audio/l16L16 audio format
-
audio/opusOPUS audio format
-
audio/alawALAW audio format
-
audio/mulawMULAW audio format
-
audio/webmWEBM audio format
The sample rate of the audio.
No description provided.
Always set to "audio".
The URI of the audio.
DocumentContent
A document content block.
The document content.
The mime type of the document.
Possible values:
-
application/pdfPDF document format
-
text/csvCSV document format
No description provided.
Always set to "document".
The URI of the document.
ImageContent
An image content block.
The image content.
The mime type of the image.
Possible values:
-
image/pngPNG image format
-
image/jpegJPEG image format
-
image/webpWebP image format
-
image/heicHEIC image format
-
image/heifHEIF image format
-
image/gifGIF image format
-
image/bmpBMP image format
-
image/tiffTIFF image format
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "image".
The URI of the image.
TextContent
A text content block.
annotations array (Annotation) (optional)
Citation information for model-generated content.
Possible Types
FileCitation
A file citation annotation.
User provided metadata about the retrieved context.
The URI of the file.
End of the attributed segment, exclusive.
The name of the file.
Media ID in-case of image citations, if applicable.
Page number of the cited document, if applicable.
Source attributed for a portion of the text.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "file_citation".
PlaceCitation
A place citation annotation.
End of the attributed segment, exclusive.
Title of the place.
The ID of the place, in `places/{place_id}` format.
review_snippets array (ReviewSnippet) (optional)
Snippets of reviews that are used to generate answers about the features of a given place in Google Maps.
Fields
The ID of the review snippet.
Title of the review.
A link that corresponds to the user review on Google Maps.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
No description provided.
Always set to "place_citation".
URI reference of the place.
UrlCitation
A URL citation annotation.
End of the attributed segment, exclusive.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
The title of the URL.
No description provided.
Always set to "url_citation".
The URL.
WordInfo
Word-level ASR annotation for transcription output. Carries the word text, optional timing, and optional speaker attribution.
End of the attributed segment, exclusive.
End offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
Optional. Speaker label for this word (e.g. "spk_1", "spk_2"). Present when diarization_mode is set in TranscriptionConfig.
Start of segment of the response that is attributed to this source. Index indicates the start of the segment, measured in bytes.
Start offset in time of the word relative to the start of the audio. Present when timestamp_granularities contains "word".
The transcribed word.
No description provided.
Always set to "word_info".
Required. The text content.
No description provided.
Always set to "text".
VideoContent
A video content block.
The video content.
The mime type of the video.
Possible values:
-
video/mp4MP4 video format
-
video/mpegMPEG video format
-
video/mpgMPG video format
-
video/movMOV video format
-
video/aviAVI video format
-
video/x-flvFLV video format
-
video/webmWebM video format
-
video/wmvWMV video format
-
video/3gpp3GPP video format
A user-defined name for this content block. Can be referenced by the model in the final response.
processing MediaProcessing or enum (string) (optional)
How the model processes this video for understanding.
resolution MediaResolution (optional)
The resolution of the media.
Possible values
-
lowLow resolution.
-
mediumMedium resolution.
-
highHigh resolution.
-
ultra_highUltra high resolution.
No description provided.
Always set to "video".
The URI of the video.
No description provided.
Always set to "user_input".
System instruction for the interaction.
tools array (Tool) (optional)
A list of tool declarations the model may call during interaction.
Possible Types
CodeExecution
A tool that can be used by the model to execute code.
No description provided.
Always set to "code_execution".
ComputerUse
A tool that can be used by the model to interact with the computer.
Optional. Disabled safety policies for computer use.
Possible values:
-
financial_transactionsSafety policy for financial transactions.
-
sensitive_data_modificationSafety policy for sensitive data modification.
-
communication_toolSafety policy for communication tools (e.g. Gmail, Chat, Meet).
-
account_creationSafety policy for account creation.
-
data_modificationSafety policy for data modification.
-
user_consent_managementSafety policy for user consent management.
-
legal_terms_and_agreementsSafety policy for legal terms and agreements.
Whether enable the prompt injection detection check on computer-use request.
The environment being operated.
Possible values:
-
browserOperates in a web browser.
-
mobileOperates in a mobile environment.
-
desktopOperates in a desktop environment.
The list of predefined functions that are excluded from the model call.
No description provided.
Always set to "computer_use".
FileSearch
A tool that can be used by the model to search files.
The file search store names to search.
Metadata filter to apply to the semantic retrieval documents and chunks.
The number of semantic retrieval chunks to retrieve.
No description provided.
Always set to "file_search".
Function
A tool that can be used by the model.
A description of the function.
The name of the function.
The JSON Schema for the function's parameters.
No description provided.
Always set to "function".
GoogleMaps
A tool that can be used by the model to call Google Maps.
Whether to return a widget context token in the tool call result of the response.
The latitude of the user's location.
The longitude of the user's location.
No description provided.
Always set to "google_maps".
GoogleSearch
A tool that can be used by the model to search Google.
The types of search grounding to enable.
Possible values:
-
web_searchSetting this field enables web search. Only text results are returned.
-
image_searchSetting this field enables image search. Image bytes are returned.
No description provided.
Always set to "google_search".
McpServer
A MCPServer is a server that can be called by the model to perform actions.
allowed_tools array (AllowedTools) (optional)
The allowed tools.
Fields
The mode of the tool choice.
Possible values:
-
autoAuto tool choice.
-
anyAny tool choice.
-
noneNo tool choice.
-
validatedValidated tool choice.
The names of the allowed tools.
Optional: Fields for authentication headers, timeouts, etc., if needed.
The name of the MCPServer.
No description provided.
Always set to "mcp_server".
The full URL for the MCPServer endpoint. Example: "https://api.example.com/mcp"
UrlContext
A tool that can be used by the model to fetch URL context.
No description provided.
Always set to "url_context".
Output only. The time at which the response was last updated in ISO 8601 format (YYYY-MM-DDThh:mm:ssZ).
usage Usage (optional)
Output only. Statistics on the interaction request's token usage.
Fields
cached_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of cached token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
grounding_tool_count array (GroundingToolCount) (optional)
Grounding tool count.
Fields
The number of grounding tool counts.
The grounding tool type associated with the count.
Possible values:
-
google_searchGrounding with Google Web Search and Image Search, & Web Grounding for Enterprise.
-
google_mapsGrounding with Google Maps.
input_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of input token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
output_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of output token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
tool_use_tokens_by_modality array (ModalityTokens) (optional)
A breakdown of tool-use token usage by modality.
Fields
modality ResponseModality (optional)
The modality associated with the token count.
Possible values
-
textIndicates the model should return text.
-
imageIndicates the model should return images.
-
audioIndicates the model should return audio.
-
videoIndicates the model should return video.
-
documentIndicates the model should return documents.
Number of tokens for the modality.
Number of tokens in the cached part of the prompt (the cached content).
Number of tokens in the prompt (context).
Total number of tokens across all the generated responses.
Number of tokens of thoughts for thinking models.
Total token count for the interaction request (prompt + responses + other internal tokens).
Number of tokens present in tool-use prompt(s).
webhook_config WebhookConfig (optional)
Optional. Webhook configuration for receiving notifications when the interaction completes.
Fields
Optional. If set, these webhook URIs will be used for webhook events instead of the registered webhooks.
Optional. The user metadata that will be returned on each event emission to the webhooks.
Output only. The time when the trigger was last paused.
Output only. The time when the trigger was last resumed.
Output only. The time when the trigger was last run.
Optional. The maximum number of consecutive failures allowed before the trigger is automatically paused (status becomes ERROR).
Output only. The time when the trigger is scheduled to run next.
Output only. The ID of the last interaction created by this trigger.
Required. The cron schedule on which the trigger should run. Standard cron format.
Output only. The current status of the trigger.
Possible values:
-
activeThe trigger is active and will fire on schedule.
-
pausedThe trigger is paused and will not fire.
-
errorThe trigger has entered an error state due to consecutive failures.
Required. Time zone in which the schedule should be interpreted.
Output only. The time when the trigger was last updated.