MediAssist

What it does

Inspiration:
The rapid growth of industries has increased pollution, leading to more health issues. With limited access to doctors, it’s vital for people to be informed about health. Our app helps users to manage their health by providing medical information.
About the Project:
The goal of MediAssist is to create a medical app to help users manage minor health issues. It offers three key features: medication identification through image recognition, an AI doctor powered by Google’s Gemini API for answering health questions, and a calendar with reminders for health tasks. How do we build our project:
We researched applying Gemini to medicine image understanding and chatbots, and gathered Vietnamese medical data using bots and human workers. We fine-tuned the model, and optimized it with Few-Shot prompting.
Our AI doctor app uses a Python-based AI chatbot with Google Generative AI for model tuning and RESTful APIs. The Gemini 1.0 Pro model processes input from the React Native front end. For medication identification, images are converted to base64 and analyzed by the Gemini 1.5 Pro model. Medication names are matched in our database, and results are sent back to the front end. The Create Calendar feature allows users to set reminders for medication, with notifications managed through Docker containerized backend services. All components are built with React Native and integrated with push notifications.