Formtune

What it does

With Formtune, when you upload a video of a sports scene, AI analyzes it and This is an application that gives advice like a professional coach.

There are three main features of the service.
1.The service is designed to be easy to use, allowing users to receive a diagnosis simply by uploading a video.
2.The service provides advice from several perspectives, so users can easily identify their weak points.
3.The service can be deployed in a wide range of sports, thus contributing to the development of sports competitions.

How to use the Gemini API
1. Receive video file data passed from the Web on a server created with Node.js
2. Upload the video file in advance using GoogleAIFileManager
3. Pass a pre-defined prompt that checks the form of the basketball in the video file and returns it as JSON to the Gemini API, specifying the model of gemini-1.5-pro along with the URI of the video file.
4. After receiving the response from the Gemini API, delete the used video file and send the response back to the web, and display the results based on JSON on the web side.