Open Multi-Modal Personal Assistant

Turn your embedded devices into companions with multimodal gen AI, RAG

What it does

Forget clunky AI pins! Your smartphone or smartwatch already has the potential to be your personal AI powerhouse. This open-source project harnesses the full might of generative AI, multi-modal capabilities, multi-turn tool function calls, and RAG (Retrieval Augmented Generation) for personalization and relevant memories to turn your existing devices into intelligent companions. In the video I demonstrate voice chat (featuring function calls and RAG), image chat, image translation, special translation (Chirp auto detect mode for STT) modes. I demonstrate how to easily personalize the companion. The main human interface is voice or image.

Built with

  • Flutter
  • Android
  • Chirp
  • Text to Speech
  • Dart Gemini SDK

Team

By

Inspector Gadget

From

United States