NoteCast

What it does

Notecast enables students to upload and interact with their lecture notes, including PDFs, text, photos, audio, and video. Users can ask questions and receive context-aware responses based on their uploaded content, and also interact with an AI conversational agent that references the media. Quizzes are generated and a user may share a generated quiz by copying the quiz link and sharing it with friends fostering learning with others via a link.
The app consists of four main pages:
1. Record: Users can record lectures in any language. Gemini API is employed to generate embeddings of the transcribed lecture. These embeddings, along with the lecture data, are stored in the database, making the content searchable and reusable.
2. Generate: Gemini is used to generate notes, an audio lecture, and quizzes based on user queries. The app turns user queries into embeddings, searches the database, and uses Gemini to generate the notes from the search results. The quiz is generated using gemini JSON mode by passing the generated notes as an argument to a function written to generate quizzes. A user may also upload PDFs, text, photos, audio, and video and have transcriptions and embeddings generated with the Gemini API and stored in the database.
3. Tutor: This page features an AI conversational agent that can embed user questions, search the database, and converse using the search results. This allows users to engage in meaningful dialogues with the content they've uploaded.