Geolingo

What it does

Our app is an Engaging AI generated language flashcard maker that makes language flashcards from images the user uploads, powered by Gemini. User creates a new card deck, adds in images, and Gemini takes over to extract text, and translate the extracted text, hence building an image and its translated word pair. User can create or join parties, collaborating with shared card decks. User can view global card decks contributed by Geolingo's community by selecting the markers shown on the map. User can also use Geolingo to plan his trip itinerary, and an interactive map shows user visually where the locations are, including important amenities like Clinic, Gym, Restaurants near the entered destination.

1) Gemini Flash's Multimodal capabilities was used to first extract the texts in the image given regardless of whatever language it was. Gemini Flash was then used again to translate the extracted text, forming an image-word pair that's stored in Firestore. The whole app was only made possible because of the NoSQL format firebase Firestore has.

2) Gemini will first build the (AI)tinerary using Markdown format, guided by system prompts, and then process the result again to extract the places mentioned in the itinerary. We use Geo-Coding and Places API from Google Cloud Platform(Maps) to dynamically display the markers on the interactive map, corresponding to the locations mentioned in the itinerary. This makes a very complete experience.