Gemini for Android is getting two new options that can enable customers to ask questions on their smartphone’s present display screen. Dubbed ‘Ask about this display screen’ and ‘Ask about this video’, these instruments seize a screenshot and course of the content material of the display screen. Then, when prompted by the consumer, it may well reply with related info that the consumer is in search of. The video function, which solely seems to be suitable with YouTube, can even present video summaries supplied there are captions added to the video.
Gemini Now Lets Customers Ask Queries About Their Display screen
Devices 360 employees members noticed the options within the Google app model 15.33.38.28.arm64 and later in a number of totally different smartphones. These seem on the highest of the Gemini floating window when a consumer summons the AI assistant. Those that have entry to the function will see a separate rectangular strip with the textual content “Ask about this display screen” and a screenshot icon. If Gemini was activated whereas taking part in a video on YouTube, the textual content is changed with “Ask about this video” and the YouTube icon.
Gemini Ask about this display screen function
Tapping the icon for ‘Ask about this display screen’ captures a short lived screenshot inside Gemini, after which the consumer can ask any question concerning the display screen. The responses will solely be based mostly on what the AI can see within the screenshot, nonetheless, customers can even immediate Gemini to entry the Web to seek out extra info. One among its use instances may very well be asking for a brief abstract of a information article.
To ask a follow-up query, customers can simply faucet the microphone icon or the keyboard icon on the backside of the floating window. Notably, the captured screenshot is just not saved on the system. Moreover, lengthy screenshots usually are not supported with this function.
The ‘Ask about this video’ function solely works for a YouTube video the place captions have been added. In our testing, we discovered that no different video platform, regardless of the standing of captions, was suitable with the function. Nevertheless, on a YouTube video, utilizing the function permits customers to ask questions concerning the video. The solutions are generated based mostly on the captions, and the video itself is just not analysed.
