FreshPick AI

What it does

FreshPick AI is designed to revolutionize the way people choose their produce by making fresh selection effortless and accurate. Integrated directly with WhatsApp, users can simply snap a picture of their produce while shopping and send it to our bot. We use the powerful capabilities of the Gemini 1.5 Flash to analyze these images. When an image is received, Gemini processes it by looking for specific visual characteristics that indicate freshness, such as color uniformity, texture, ripeness, and signs of spoilage like bruising or discoloration. We use a carefully crafted prompt that instructs Gemini on what visual attributes to assess for different types of produce. This prompt is built with data gathered from multiple reputable websites, categorizing the characteristics of fresh vegetables and fruits, along with some of my own expertise in picking produce. The prompt specifically instructs the model to only analyze visual characteristics while suggesting other important factors like sound, touch, feel, and firmness directly to the user.
Gemini 1.5 Flash is very fast, and while we experimented with models that returned full images with marked boundaries in response, we found that with prompt engineering and some help from the cookbooks, we could get just the bounding box coordinates. We overlay these coordinates onto the image. Gemini provides detailed reasoning for its selections, explaining why specific produce items are recommended based on the visual characteristics.