Moonect

What it does

The app allows users to take a picture with their phone, which is then sent to the Gemini API for analysis. The API detects various objects in the image and returns a list of relevant things in the picture. Users select a keyword from this list, instantly connecting them to a global group chat where others are discussing the same topic. Additionally, users can chat with an AI specifically about the chosen topic, enhancing their learning and connection to their surroundings. This feature also offers comfort to those who might feel lonely or need a positive distraction, inspired by concepts from “The Power of Now”, and helps a lot with reducing social anxiety.

The app’s potential is vast. For example, we could partner with brands like Coca-Cola, where users can snap a picture of a product to join a special group chat and access exclusive offers. Friends could use a secret object as a password to create private groups, and there are many more possibilities.

I've utilized the Gemini-1.5-Flash model for both image analysis and the AI chat functionality, as it’s lightweight and provides accurate responses for this MVP. To ensure safety and appropriateness, we’ve implemented filters using the HarmCategory feature provided by the Gemini API. The chat is stored in firebase firestore and we've used Google Sign In from Firebase Authentications as well.