VivaEval

What it does

VivaEval is designed to improve the lives of middle and high school teachers. It automates the testing and evaluation process with a type of test / assignment that cannot be easily compromised by readily available LLMs. This should save our overworked teachers 5-10 hours per week.
When the test begins, VivaEval asks the student (or user) a question and awaits a response. At this point, the app uses Gemini 1.5 Pro to:
1. Create the transcript of the audio input. (I didn’t use the audio input directly since it’s easier/faster to keep track of the entire conversation via text).
2. Conduct a sanity check to ensure that the user is not trying to access the prompt or say something irrelevant. 3. Come up with a response to the user's input; considering the conversation so far and the test outline given by the teacher.
The response is then synthesized to an audio file. When the user is done answering all questions, they are prompted to hit “End Conversation”. At this point the app has 1or 2 calls to the Gemini 1.5 Pro API to: 1. Go through the transcript of the conversation and the grading rubric; and assign a score for each point that was supposed to be covered in each question. Then compile the results into a json.
2. On some occasions the ‘json’ created in the previous point is not ‘parsable’; and so the app asks Gemini to correct the json structure.
Looking ahead, I plan to incorporate audio and video analysis into VivaEval to further enhance academic integrity.