Abuse monitoring

Google is committed to the responsible development and use of AI. To ensure the safety and integrity of the Gemini API, we have created these policy guidelines. By using the Gemini API, you agree to the following guidelines, the Gemini API Additional Terms of Service and Generative AI Prohibited Use Policy.

How We Monitor for Misuse

Google's Trust and Safety Team employs a combination of automated and manual processes to detect potential misuse of the Gemini API and enforce our policies.

  • Automated Detection: Automated systems scan API usage for violations of our Prohibited Use Policy, such as hate speech, harassment, sexually explicit content, and dangerous content.
  • Manual Detection: If a project consistently exhibits suspicious activity, it may be flagged for manual review by authorized Google personnel.

How We Handle Data

To help with abuse monitoring, Google retains the following data for fifty-five (55) days:

  • Prompts: The text prompts you submit to the API.
  • Contextual Information: Any additional context you provide with your prompts.
  • Output: The responses generated by the Gemini API.

How We Investigate Potential Issues

When prompts or model outputs are flagged by safety filters and abuse detection systems described above, authorized Google employees may assess the flagged content, and either confirm or correct the classification or determination based on predefined guidelines and policies. Data can be accessed for human review only by authorized Google employees via an internal governance assessment and review management platform. When data is logged for abuse monitoring, it is used solely for the purpose of policy enforcement and is not used to train or fine-tune any AI/ML models.

Working with You on Policy Compliance

If your use of Gemini doesn't align with our policies, we may take the following steps:

  • Get in touch: We may reach out to you through email to understand your use case and explore ways to bring your usage into compliance.
  • Temporary usage limits: We may limit your access to the Gemini API.
  • Temporary suspension: We may temporarily pause your access to the Gemini API.
  • Account closure: As a last resort, and for serious violations, we may permanently close your access to the Gemini API and other Google services.

Scope

These policy guidelines apply to the use of the Gemini API and AI Studio.