Accessible Earth

What it does

This Google Earth extension leverages the Gemini API to offer an AI-guided virtual world travel experience. Key features include:

AI Assistant Dialogue:
Gemini API enables real-time conversations between users and the AI assistant. By including context and location data, the API generates relevant responses to user queries.
Voice Interface:
Integrates Speech-to-Text and Text-to-Speech capabilities for hands-free operation, enhancing user immersion.
Location-Aware Functionality:
Real-time location data from Google Earth is sent to Gemini API, allowing the AI to provide location-specific information and context-aware conversations.
Intelligent Movement:
Gemini API analyzes user requests for location changes. It uses Google Maps Geocoding API to obtain coordinates and updates the Google Earth display accordingly.
Image Recognition:
Captures Google Earth displays and uses Gemini API's image recognition to provide detailed location information, enriching the AI's explanations with visual context.
Personalized Experience:
User preferences and conversation history are sent to Gemini API to generate personalized responses and recommendations.
Educational Content:
Utilizes Gemini API to generate real-time educational content about visited locations, covering history, culture, and geography.
Multimodal Processing:
Integrates various input modes (text, voice, images) through Gemini API for a comprehensive dialogue experience.