Zephyr

What it does

I created a runtime python API for Unreal Engine which allows for the creation of shapes, spawn points, vehicles, lights, and modification of environment lights. Players can join online multiplayer sandbox environments and build games through prompting. Each prompt includes the Unreal Engine python API and the player's request, such as "create a vehicle". The response from Gemini contains python code which is executed within the game to achieve the player's request. Multiple shapes can be created at once with a prompt like "Create a pyramid" (which Gemini usually builds with multiple stacked boxes). Existing shape groups can be modified by looking at the pyramid and describing some modification, like "Add an entryway with pillars". The server host can swap between Sandbox mode (where players build the game) and Game mode (where the game is played and the building abilities like prompting and flying are disabled). In Game mode, it looks for spawn points at opposing ends of the map and spawns 2 teams at the opposing spawn points. Note that the default spawn point which exists when the server is first created should be deleted, and at least 2 other spawns (representing the 2 team spawns) should be created before switching to Game mode. In the future, I'd like to add a feature to configure the game win condition with prompts, add more Unreal Engine capabilities, and add more settings like allowing players to use prompting during the Game mode.