Talkback on Google Gemini

In ramping up a new vision for Gemini use cases, I given a special request from Sundar.

The task:

Come up with solutions for how AI can help differently-abled users and expand our a11y (accessibility) feature sets in an ai context

Solution:

Creating a next gen screenreader powered by Gemini to handle vision deficient user experiences for both abled and differently abled users across devices and Google ecosystems.

Smartphone home screen displaying time 9:30, date Wednesday, February 24, weather 76°F, and three chat notifications from Chris, Nate, and Megan, with profile pictures and message previews. Background shows a sandy desert with dunes.
Smartphone home screen displaying time 9:30, date Wednesday, February 24, weather 76°F, and three chat notifications from Chris, Nate, and Megan, with profile pictures and message previews. Background shows a sandy desert with dunes.
A landscape photo of a coastal scene with rugged mountains in the background, a sandy shore, and water reflecting the sky, taken during sunrise or sunset.
A landscape photo of a coastal scene with rugged mountains in the background, a sandy shore, and water reflecting the sky, taken during sunrise or sunset.
A smartwatch display showing two chat messages from Chris and Mom, with a background text 'Compatible with Watch'.
Wide shot of Sydney, Australia showing the Sydney Opera House and Sydney Harbour Bridge across the water, with a clear blue sky.
Car GPS navigation screen showing a map with a blue route and a blue arrow indicating direction. On the right, a music player titled 'You got to listen' by Michael Evans playing, with playback controls. The left side has app icons including Google Maps, Spotify, a phone, and a microphone. The top right shows a message from Chris Han with the note 'mountain by beach'.

Compatible with Android Auto