Magic AI 3D Game Creator

What it does

The application is a set of 2 plugins for the SceneMax3D IDE (www.scenemax3d.com). These plugins allows the user to perform a live conversation against an AI agent where the user directs the agent on various aspects of his dream game and as they speak the game is developed in real-time until it is ready for package and deployment to various market places such as Google Play Store, Steam, ITCH etc. There are many components in that system. The role of Gemini API is to understand the user's requests and response with a set of configurations (in JSON format) which will later be converted to code and sent to the game's run-time engine for execution.
The prompt which is sent to Gemini API consists of the actual user input as well as a system instruction with the current game state and general (and specific) instructions containing knowledge about the resources and options available for the created game.