Key Takeaways
1. Google introduced a new feature called Screenshare for its AI assistant Gemini, allowing users to share their smartphone display and ask questions based on what the assistant observes.
2. This feature enhances user interaction by enabling natural conversations, building on existing technologies like Google Lens, which recognizes items on the screen.
3. Gemini’s new capabilities streamline tasks, making it easier for users and aligning it more closely with advanced AI models like ChatGPT.
4. Another feature, Gemini Live, allows the assistant to analyze and process live video from the phone’s camera for real-time assistance.
5. These features will be available to subscribers of the Google One AI Premium plan, which also includes access to Gemini Advanced and 2TB of cloud storage.
At the current Mobile World Congress (MWC) 2025 happening in Barcelona, Google unveiled some exciting new features for its AI assistant Gemini. One of these is called Screenshare, which lets users share their smartphone display with the assistant and pose questions based on what it observes.
Enhanced User Interaction
Google showcased this feature via a video, where a user shares their screen with Gemini and inquires about outfit recommendations after showing an image of a pair of jeans on a website. While this concept isn’t completely fresh for Google, as Lens can already recognize items based on highlighted screen areas, integrating it with a voice assistant for natural conversations feels like a natural progression.
Streamlining Tasks
This innovation simplifies tasks and takes care of much of the effort for users. Additionally, it pushes Gemini closer to ChatGPT, which is capable of handling multiple types of inputs including images and videos. ChatGPT also has the ability to perform real-time video analysis in an advanced voice mode, and Google is paying attention to that.
The second standout feature, introduced as part of Gemini Live, enables the assistant to analyze and process live video captured through the phone’s camera.
Practical Applications
In the demonstration video, a user activates their camera to show Gemini a vase and asks for color suggestions.
These new functionalities will soon be accessible to subscribers of the Google One AI Premium plan. This plan also offers access to Gemini Advanced along with 2TB of cloud storage.
Google is clearly making strides in enhancing user experience with these updates!
Source:
Link