EyeTalk

What it does

Our app is an Assistive Technology application which is primarily focused on aiding ALS patients. Amyotrophic Lateral Sclerosis is a Neuro degenerative disease which leaves the patient completely paralyzed. Everything including their mouth, torso and limbs are paralyzed. The only parts of their body they can move are their eyes and cheek muscles. ALS is not congenital, which means the patient grew up with a normal lifestyle and suddenly lost his ability to communicate with their loved ones. To combat this, the primary feature of the app is the communication feature which uses Google Gemini in an innovative way. When someone talks to the user the app records their voice. This recording of what they say is used by Gemini to generate appropriate responses. The users can then use simple eye movements to choose any one of the provided responses. This enables them to communicate and express their feelings even if they are completely paralyzed and can't speak. To provide the user with more independence the secondary feature of the app is Smart Home Automation, where the user can control smart home appliances like fans, lights etc, independently. The app also prioritizes safety by offering an alert feature which enables the user to alert either their caretaker or their doctor when there is an emergency. Future enhancements include entertainment features to for the users, but most importantly, integration with infrared camera to increase eye tracking accuracy in low light conditions.