Nemo Speak AAC

What it does

Nemo Speak AAC allows people who have lost the ability to communicate from stroke or neurodegenerative disease to communicate again in natural language using our mobile app.
When given context about a person's life, Gemini is exceptionally good at predicting what that person would say in response to a spoken question. We've packaged Gemini into a very simple interface that people with communication disorders can actually use - dramatically improving the speed, complexity and specificity of the responses a person can generate compared to traditional AAC devices. This is a huge leap forward in AAC technology and I believe will become standard in the next 6-12 months.
We use the gemini api sdk for flutter currently to surface the most relevant responses to a question asked. We also have a prototype of a Retrieval Augmented Generation service which we have plans to integrate with our app and deploy within the week on the Google Cloud Platform. This service uses VertexAI, LangChain, ChromaDB and Gemini to answer questions about the aphasic persons life. We are so pleased with our results. It performs much more efficiently and accurately than the current RAG system used by the app.