Google is reportedly launching new capabilities for its Gemini AI assistant on Android smartphones. In addition, it will allow users to inquire about what is currently displayed on their screens. Additionally, Gemini will now provide summaries of YouTube videos and respond to questions related to specific video content. These features were initially exclusive to the latest Pixel 9 series smartphones. However, they are now available to a broader range of Android devices.
Accessing the Google Gemini AI Assistant
To use the new feature, users can access the Gemini AI assistant by long-pressing the power button on their smartphones, which opens a floating window. A new button labeled “Ask about this screen” will appear at the top of the Gemini interface. This button takes a screenshot of the current screen and sends it to Gemini AI.
Limitations of Screen Queries
After capturing the screenshot, users can ask Gemini questions about the items displayed. However, it’s important to note that Gemini can only provide information based on the screenshot. As a result, it cannot answer questions about content beyond what is visible in the image. For instance, if a user opens a news article in a web browser and queries Gemini about it, the assistant will only have access to the data in the screenshot rather than the entire webpage. Additionally, the feature does not support capturing extended screenshots.
YouTube Video Interaction by Google
Like the “Ask about this screen” feature, Gemini also includes an “Ask about this video” function when watching selected YouTube videos. This option is available for videos that have captions. Although, it remains functional even when captions are turned off.
Once the user selects the “Ask about this video” option, Gemini AI can provide a summary of the video or answer specific questions regarding its content. It’s worth noting that this feature focuses on captioned videos and does not analyze the video visuals themselves.
Also Read: https://thecitizenscoop.com/google-meet-introduces-new-ai-powered-note-taking-feature/
