Gateway

What it does

Gateway is an accessibility app that aims to solve the issue of the lack of information available online when it comes to the dimensions of the entrances of buildings around the world. Gateway uses Gemini's powerful image processing capabilities to analyze satellite imagery of the target building, finding points on the sidewalks or streets surrounding the building that are next to the entrance of the entrance of the building. Gateway then gets Google Street View images with the Google Maps Static API pointing in the direction of the building at those points, and uses Gemini to decide which images best display a building with the name of the target building. After finding the best image, a YOLOv8 door detection model is used to accurately draw a bounding box around the entrance in the image and predict its width.