3D Plant Facility Simulator

What it does

The 3D Plant Facility Simulator is an educational application designed to immerse students in a virtual industrial environment from day one of their training. Built in PlayCanvas, the app allows users to navigate a fully interactive 3D plant facility, featuring hydraulic pumps, electric motors, a mixer, an electric cabin, and various valves. A central guide mark helps users explore the facility by highlighting key objects and suggesting questions to ask the integrated AI-driven chatbot.

The chatbot is a critical feature of the app, offering real-time, contextually relevant answers to technical questions about the plant's components. To achieve this, we utilized the Gemini API to create high-quality embeddings from a carefully curated knowledge base. When a user poses a question, it is sent from PlayCanvas to a Python server hosted on PythonAnywhere via Flask. The server then processes the question using the Gemini API to generate embeddings, which are stored and managed in Pinecone’s vector storage. These embeddings are crucial in helping the chatbot understand and retrieve the most relevant information. Finally, using Langchain, the app generates accurate and educational responses tailored to the user’s query.

This innovative approach helps bridge the gap between theoretical knowledge and hands-on experience, making it easier for instructors to teach and for students to learn complex industrial concepts in a more engaging and interactive way.