RescueMate

What it does

Rescue Mate is an advanced first-aid assistant powered by cutting-edge AI and Augmented Reality, utilizing Google's Gemini API and ARCore. With simple voice commands or the tap of a button, you can access immediate, accurate, visual, and potentially life-saving instructions tailored to the situation at hand. Our app offers two modes: practice and emergency.

Practice mode is designed to make medical training for emergencies more accessible and environmentally friendly. Users are provided with a multitude of training options, each tailored using ARCore models that leverage the depth API and environmental understanding. Each training option includes a personal Gemini Assistant that provides directions and feedback, constantly updating to adapt to the environment. This feature allows users to avoid purchasing expensive and non-recyclable medical practice kits.

In emergency mode, Rescue Mate utilizes the Gemini API to diagnose conditions based on symptoms described by the user. The Gemini API then provides guided instructions in real time, creating immersive ARCore steps that include video nodes, medical models, and more. The ML Kit Pose Detection API is used to locate body pose landmarks and accurately place these 3D models. Once first responders arrive, the Gemini API provides a detailed summary of the emergency, including important information such as patient symptoms and elapsed time, helping first responders and reducing the bystander’s stress.