Google Explains How Its Gemini Integration in Photos App Lets Users Find Photos With Prompts

Nearly a yr after unveiling its Ask Photos characteristic on the I/O developer convention in May 2024, Google has lastly shed some mild on how the characteristic will work. It was launched as an extension for Google Photos which permits the on-device Gemini synthetic intelligence (AI) assistant to entry a consumer’s photographs and reply queries about them. While the characteristic began delivery out in early entry in September final yr, the corporate has now confirmed the main points about its availability and workings.

Gemini-Powered Ask Photos Feature: How Does It Work?

According to a brand new assist doc revealed by Google, the characteristic is offered on each Android and iOS platforms. It requires customers to have Gemini and Google Photos apps put in, and have Gemini Apps Activity (previously Gemini Extensions) enabled. Further, the Gemini app ought to have the identical account logged in because the Photos app. Once performed, the characteristic is prepared for utilization.

The Mountain View-based tech big says customers can ask the Gemini app to discover a photograph in the Google Photos library. They can embrace @Google Photos or my pictures in their immediate to make sure that Gemini makes use of the Google Photos app. It works with prompts akin to:

1. Find my pictures of Alex
2. Show my pictures from final summer time
3. Show me latest selfies
4. Show my pictures from my most up-to-date journey
5. Find my pictures of landscapes

In essence, the Gemini integration in the Photos app lets customers ask conversational queries to filter out a particular picture saved on the consumer’s cloud storage. They can ask detailed queries spanning a number of sentences or pure language prompts with some primary details about the picture, enabling the AI to fetch the precise picture. They also can ask follow-up queries in case the AI will not be capable of finding the picture in the primary try.

Users can ask questions based mostly on their face teams or relationships saved in the Photos app, the placement or date the photograph was taken, an outline of what is in the photograph, or their present dialog with the Gemini cell app.