Mad-Pic

What it does

This app lets users take photos of math problems or notes to find concept explanations and related questions. You can search for similar problems in the database or snap a picture of handwritten notes, and the app will find relevant math problems for you to practice.

The app has three modes: problem-focused, explanation-focused, and a combined mode. If you want to find similar questions, use the problem-focused mode. For exploring concepts, the explanation-focused mode is recommended. Teachers have preferred the explanation-focused mode in tests.

To save costs, we included a “Text Only” option, bypassing image interpretation for problems without pictures. This app is built on a service that stores Korean math problems using vector embedding. The app automatically categorizes and vectorizes problems from PDF files, with around 15,000 problems currently stored.

The app uses vector search to find relevant problems, requiring concept and image interpretation. The Gemini API is used for concept interpretation, generating explanations that match similar embeddings in the database. We also explored image analysis but found it more complex than expected. In the future, we plan to use the Gemini API to create a user-driven database with photos, and the basic code for this is already prepared.