Chat inference for creating 3D sheets

What it does

The application is a chatbot that provides additional chat interface functionality for the 3DStreet.app application of the 3DStreet.org project. The 3DStreet project is a tool for creating 3D street layouts for interested parties such as city planners. The chatbot allows to create a 3D model of a street using a text description from the user, as well as change any parameters of the created model. It can suggest different options for making the street safer for pedestrians, cyclists or cars, based on best practices in urban planning. And instantly display user-selected suggestions on a 3D street model. Interaction takes place in a dialogue format. The Gemini API is used to generate a response based on the user's request. Information about the Streetmix JSON data format, used to generate 3D street models in 3DStreeet, was loaded into the Gemini model during initialization. Also, the behavior and capabilities of the chat bot were also described. The model was also loaded with information about the currently available types of street segment types (such as sidewalks, bike-lane, drive-lane, etc) and their variants. The function_call mechanism is used to represent the structure of the proposed street model in Streetmix JSON format for user requests of street generating. Currently the chatbot is still undergoing testing and debugging, but it can do all of the above.