Screenchat

What it does

Screenchat is an AI assistant app that can see your device screen and hear its internal audio, allowing you to ask anything based on what’s happening on your screen.
Example Use Cases:
Open a browser and start searching for a specific topic.
Ask it to summarize key points and provide relevant information.
Learning a New Skill:
Open a tutorial video.
Ask it to break down complex steps and provide additional resources.
Knowledge-share & Knowledge-base Marketplace Feature:
Screenchat provides a platform where users can share their knowledge via PDFs, videos, or audio, and anyone can apply it to accomplish tasks.
Example Use Case:
A person proficient in writing cold emails shares their knowledge. Imagine you want to write a cold email to apply for a job. You apply that knowledge, share your screen, browse through any HR profile as you normally do, and ask Screenchat to write a cold email for you. Screenchat will analyze the HR profile and combine it with the shared cold email knowledge to write a personalized cold email for you.
Gemini API Usage:
Screenchat sends screen recordings with internal audio to the Gemini API at certain intervals. When a user asks a query, we send it to Gemini for processing.
For the Knowledge-share & Knowledge-base marketplace feature, Screenchat stores user knowledge as PDF, audio, or video files. When a user applies that knowledge, it sends the relevant file to Gemini for context, enhancing the personalized assistance provided by the app.