background

Gemini Live Adds Real-Time Captions on Android and iOS

It will even let you create and save a note in Google Keep

Siddhartha Samaddar profile picture
by Siddhartha Samaddar

Published 2 days ago

facebook iconfacebook icon
whatsapp iconwhatsapp icon
twitter icontwitter icon
Link Copied
copy link iconcopy link icon
Google Gemini logo on a black background with similar patterns

Image Credit: Beebom Gadgets

Summary

  • Gemini Live is rolling out live captions support for Android and iOS.
  • It will let users overlay a caption window to receive text-based responses without needing to turn their device volume up.
  • Additionally, Google is integrating its Keep note-taking app with Gemini.

Google's Gemini Live is a nifty feature that allows users to have natural and free-flowing conversations with the AI assistant. And now, Google is supercharging Gemini Live with Live Captions.

Initially spotted by 9to5Google, with Live Captions toggled on, Gemini will not require you to increase your device volume every time you interact with it. This makes talking to Gemini Live way easier, especially in loud and crowded places.

Gemini Live, live caption feature in actions
Image Credit: Beebom Gadgets (edited by Siddhartha Samaddar/Beebom Gadgets)
Gemini Live, live caption feature in actions
Image Credit: Beebom Gadgets (edited by Siddhartha Samaddar/Beebom Gadgets)

We were able to get the feature working on our end. And as you can see from the above image, the top-left corner of the Gemini Live window now has an option to enable Live Captions. Once enabled, it overlays the AI's spoken responses in an almost centre-aligned floating overlay.

The good thing is it still maintains the natural free-flowing capability of Gemini Live. We were able to ask it follow up questions and it successfully gave textual responses within the Live Caption overlay.

Gemini Live, live caption feature settings page with more options
Image Credit: Beebom Gadgets (edited by Siddhartha Samaddar/Beebom Gadgets)
Gemini Live, live caption feature settings page with more options
Image Credit: Beebom Gadgets (edited by Siddhartha Samaddar/Beebom Gadgets)

Users will also be able to customise the Live Caption experience, like changing the caption size and style and the language of the captions. To do so, one can simply visit the new Caption preferences option on the Gemini Settings page.

At the time of writing, the live caption feature supports 30+ local Indian languages like Hindi, Bengali, Marathi, French, German, Russian, and so on.

While the Live Captions feature is a handy addition to Gemini Live, another nifty trick that Google has shipped is the ability to create and export notes directly from Gemini Live to Google Keep.

So, users will now be able to take notes on the fly, like creating grocery lists, asking Gemini to take note of important conversational pointers and so on. Even the Gemini Live camera feed will let you ask it to add pointers in a dedicated Keep document.

With that being said, the Live Captions feature is now rolling out widely to Android and iOS users, in both India and globally. 

Siddhartha Samaddar profile picture
Siddhartha Samaddar

Tech News Writer

Expertise :

Siddhartha is a tech writer with 2.5 years of experience, focused on making tech easy to understand for everyone. He enjoys breaking down complex ideas into simple, helpful bite-sized content. Outside of work, he loves reading books and often finds himself daydreaming about the dream gaming setup he hopes to build someday.

linkedin iconlinkedin icon
twitter X icontwitter X icon
email iconemail icon