Since Gemini began changing Assistant on Android, Google continued to provide it essential enhancements, making it an much more succesful AI chatbot. Over this week, new functionalities have graced in Gemini together with an on-screen contextual function and an extension in Gmail, bringing the AI remedy to customers’ inboxes.
Gemini’s on-screen consciousness function hits extra customers
Whereas Gemini on the Pixel 9 and Pixel 9 Professional (overview) comes with the “Ask about this screen” function, this has solely began rolling out to extra Android customers just lately. It’s noticed (by way of AndroidPolice) that the most recent Google app beta allows a screen-aware function in Gemini, letting customers get insights on their telephone’s display screen together with YouTube movies by way of “Ask about this video.”
“Ask about this screen” seems as a button above the Gemini floating window. Tapping it’ll have the Gemini assistant take a screenshot and analyze what’s in your present display screen. Subsequently, you possibly can fine-tune your queries with textual content or voice prompts. It also needs to be famous that the screenshots generated are solely non permanent and not saved to your gallery.
This helps texts, photographs, and movies (YouTube) and may give you summaries, descriptions, and solutions. Once you’re on YouTube, the perform is usually the identical however the button and label will change to “Ask about this video,” which could be launched equally to the textual content model.
Our colleague Antoine already examined the function on the Pixel 9 Professional XL, which has proven to be able to summarizing movies so long as these have captions or transcripts on them. Moreover, Gemini can even provide you with recipes based mostly on the pictured elements.
It is unclear as to which units are supported by this function through the preliminary launch, however it ought to be out there to Google One AI subscribers.
Gemini can now higher filter your emails
Individually, Google has additionally rolled out Gmail Q&A, which is a Gemini software for the Gmail app for Android. It is out there to customers with any of the Google One AI premium subscriptions. It’s deliberate to be added to the iOS model of the app quickly, though the corporate did not specify when.
As for Gemini Q&A, it comes as a brand new button positioned beside the primary search bar on the high. By launching it, you possibly can ask for particular actions like trying to find particular objects in your emails, summarizing emails, exhibiting unread objects, and extra.
Nevertheless as famous by Google, the preliminary launch has solely the search perform current, although the corporate mentioned they’re going to add extra capabilities within the coming weeks.
Do not forget that this can be a completely different function when composing messages or emails utilizing Gemini, which can be one other premium software beneath the Google One AI plans.
How’s your expertise with Gemini to this point? Which AI options have you ever been utilizing probably the most? Tell us within the feedback.