Gemini Live Adds Visuals, Integrates with Android

Image source: theverge.com

## Google Updates Gemini Live with Visual Recognition and App Integrations

Google is rolling out a suite of new features for Gemini Live, its AI-powered real-time conversation assistant. The enhancements aim to make the tool more intuitive and integrated into users’ daily routines, marking a step toward a more natural and interactive AI experience.

### Visual Assistance and Device Rollout

A key addition is “Visual Guidance,” allowing Gemini Live to highlight objects visible through the user’s camera during shared conversations. This functionality enables real-time identification of items, such as tools or products. The feature will initially launch with the upcoming Pixel 10 devices on August 5th, followed by broader availability across Android devices, and subsequently for iOS users in the coming weeks.

### Seamless Integration with Existing Apps

Gemini Live will also gain integration with several core Android applications including Messages, Phone, and Clock. This will allow users to perform actions within the Gemini Live conversation flow, such as responding to texts or pausing directions to make a quick call.

### Improved Speech Capabilities

Further enhancing the user experience, Google is introducing an improved audio model for Gemini Live. This will allow the AI assistant to better understand and replicate human speech patterns, including adjustments for speaking speed and even the ability to request dramatic retellings with customized accents.

Source: https://www.theverge.com/news/763114/google-gemini-live-ai-visual-guidance-speech-update