Gemini Lens

What it does

Gemini Lens is an Android app that revolutionizes the interaction between users and their smartphones, making everyday tasks easier. Integrated directly into the device's quick settings, Gemini Lens can be launched with just a single tap. Upon activation, the app takes a screenshot of the current screen and uses the Gemini API to understand its content. Based on this analysis, it provides context-aware action suggestions, such as creating calendar entries, translating text, writing notes, creating shopping lists, recipes, and much more.
Users can either select one of the suggested actions or input their own commands through typing or voice input. The Gemini API processes these inputs and selects a suitable action, which is then displayed to the user. These actions may include text-based tasks, allowing users to share, copy, or further refine the generated content. Refinement can be done manually by the user or through quick actions, also generated by the Gemini API based on the text. There are also actions that allow users to create calendar or contact entries with just a single tap.