Virtual Spokesperson (MVP)
AI representative who talks on your behalf to solve your problems
What it does
It's a backend that receives text from speech of phone call, transforms into actions and execute those actions. The flow is:
- User call the number and give it a action ("Call the local pharmacy and check if they have headache medicine")
- The system, using Gemini API, asks all the needed informations for the action (like names, phone numbers, address...)
- When the system has all the info, the call ends
- Then the system review the call (using Gemini API) and transform into actions (and take notes from important info)
- After that, the system execute the action (make a outbound call) and talk to target person of action
- When the system get the information needed to consider the action completed, the outbound call ends
- Finally, the system call the user back with the summary from the action
The gemini API is used to process all the text/chat:
- The text from the phone call
- The reasoning for reviewing and transforming the chat into actions
- The reasoning for reviewing and transforming the chat into notes
- The reasoning for reviewing and transforming the chat into summary for the return call
Built with
- Firebase
Team
By
Felippe Gallo
From
Brazil