Project Stargate

What it does

Project Stargate the AI application is an early prototype for an automated evaluation system (or just a fun sketching/guessing game!) currently stargate utilises the Gemini model to simulate the role of a monitor within a remote viewing session - the monitor in a remote viewing session guides a viewer through a session, attempting them to keep on a signal line and describe the images that come to them in more detail. Gemini is also used to the full multimodal advantage be including in sketch data which typically the programme monitors in a remote viewing session would analyse after a session - this automation gives the AI Monitor (Gemini) 'eyes' to see what the viewer is sketching at a particular time and how these sketches may relate to a clearer picture of a location or object that will be gathered over the session. The application also benefits from use of the Imagen 2 model to generate live models of the potential remote viewing target based on the details provided in the conversation and the sketches (meaning that even as someone as bad at drawing as me can enjoy the process of a remote viewing session too!) some initial groundwork has be laid for the integration of a retrieval augmented generation system into the chatbot with myself developing a Firestore Langchain Record Manager (PR is in) this record manager will allow us to take full advantage of Firestore for document management for the retrieval augmented generation gemini chatbot. Future work outlined on the repo