Guided Vision launches today in Gemini Live on compatible Android devices to use AI to give real-time audio descriptions of whatever you point your phone’s camera at. By sharing your camera in Gemini Live, you can get help from Google’s AI with tasks like reading small text, describing your surroundings, finding or identifying objects around you, and describing details about specific objects.
Like the VoiceOver Live recognition feature that Apple added to iPhone and Vision Pro, it is designed for people who are blind, visually impaired, or want help in specific situations. In addition to the Gemini app, Guided Vision is also available in Google TalkBack, or users can set up an accessibility shortcut in the Settings app on devices running Android 9 and later, after it was announced in a recent round of Pixel updates.
You can also ask follow-up questions about anything you’re looking at, like asking Gemini to read the expiration date of an item it helped you find. Google says Gemini will give you audio cues to help you align your camera if you ask about something that’s not in the photo. However, Google warns users not to rely on Guided Vision for things like “navigation, safe guidance, or obstacle detection,” or as a replacement for a cane or mobility aid.
Gn tech
