MAG

What it does

MAG is a personal desktop companion. It will talk with you, remind you to do things, takes care of your health, helps in cooking a yummy food. It remembers things like your health, likings, and changes its behaviour accordingly. It will look at(via camera) food in your hand and give you nutrition information and recipes.
The app is built as a android app running in custom ROM in Raspberry PI. With the rest of the hardware it becomes your buddy. It has access to healthcare devices like pulse oxymeter, ecg etc, But this can run in mobile devices as well since this is android app but with limited functionalities.
The speech is converted to text and sent to Gemini for getting the response. The photos from camera are sent to Gemini as well which with its multi model capabilities enable a multi-faceted and intelligent interaction.
Firebase is used to store the conversation and for retrieval, calendar, reminders etc. Firebase vector search is used for searching through MAG's memory so that it can respond to you appropriately.