Join the Gemini API Developer Competition! Learn more

google.generativeai.protos.CountTokensResponse

View source on GitHub

A response from CountTokens.

It returns the model's token_count for the prompt.

Attributes
`total_tokens`	`int` The number of tokens that the `model` tokenizes the `prompt` into. Always non-negative. When cached_content is set, this is still the total effective prompt size. I.e. this includes the number of tokens in the cached content.
`cached_content_token_count`	`int` Number of tokens in the cached part of the prompt, i.e. in the cached content.

Attributes

total_tokens

int

The number of tokens that the model tokenizes the prompt into.

Always non-negative. When cached_content is set, this is still the total effective prompt size. I.e. this includes the number of tokens in the cached content.

cached_content_token_count

int

Number of tokens in the cached part of the prompt, i.e. in the cached content.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2024-06-21 UTC.