HOPE

What it does

With our application, digitizing medical reports has become easy. Users can add images of lab reports using the Gemini Files API, and the Gemini Content Generation APIs extract the information into a specified JSON format, which is then saved in the database. Afterward, the uploaded file is deleted using the Files API. This data extraction to JSON is a lifesaver, as reports come in various formats due to laboratories not following a common template.

We use chat with function calling, helping patients clarify doubts, receive diet suggestions based on doctor recommendations, and retrieve information with simple prompts like “Show me the report dated 08-11-2023.” Here, Gemini acts as a healthcare companion, making healthcare more accessible to users across the world. Even a simple diet suggestion can significantly impact one’s health over time.

For doctors, Gemini serves as an assistant, answering queries related to patients, such as “Show me all the reports done so far,” “Show me the test details for fasting glucose,” or “Give me a brief summary of the patient’s medical condition.” This helps doctors better understand a patient’s health history without requiring extensive input from the patient. Additionally, this functionality helps overcome language barriers between patients and doctors; patients only need to convey their concerns, and the doctor can access the necessary information with the assistant's help.