Presented in our columns at the end of March, the Gemini Live feature with camera and screen sharing is now available. This experience, from Project Astra presented at Google I/O 2024, gives artificial intelligence the ability to have an "eye" via the screen or camera. The new feature is available in more than 45 languages, including French, and represents an important step for Google in its quest to offer a universal AI assistant capable of understanding and interacting with the world around us.
Gemini has eyes: how does it work?
The first new feature, screen sharing, offers Gemini the ability to analyze what is displayed on the smartphone screen and answer questions about what it sees. The Google Assistant replacement can also use the camera to view live and interpret in real time the video stream that appears on the screen to provide assistance.
The American giant already mentions different ways to use these features, such as to organize your space. "Start by photographing a messy drawer, a cluttered closet or an overflowing shelf. Ask Gemini provides advice on organizing your belongings, optimizing space, or even identifying what you can donate or throw away,” the Californian firm says.
In addition to being an organizational partner, Gemini Live can help with creative projects or provide advice on how to repair a malfunctioning device.
Among other possible uses, screen sharing is used to get personalized shopping advice. “Gemini becomes your personal shopping assistant […] You can even show Gemini specific items and ask what would make them look best using your camera to showcase your own wardrobe. Get instant feedback on your choices and make informed (and stylish) purchases,” says Google.
A free feature for the Pixel 9 and Galaxy S25
Google says this new feature is available to all Gemini Advanced subscribers on an Android smartphone. Remember that the subscription costs €21.99 per month and that a 30-day trial is possible.
In addition, it arrives free for all Gemini users of the Pixel 9 (including the Pixel 9a) and Samsung Galaxy S25. Samsung specifies that the free deployment begins today and concerns the entire Galaxy S25 series.
0 Comments