Tag: Google Lens

  • Google Launches Circle in Search for iPhones with Restrictions

    Google Launches Circle in Search for iPhones with Restrictions

    Key Takeaways

    1. Circle to Search has expanded from Google and Samsung phones to more Android devices and now to Apple devices, but with limitations.
    2. On Android, users can easily use Circle to Search across almost all apps by long-pressing the navigation bar.
    3. iPhone users have a restricted experience, only able to access the feature within the Google app and Chrome through a three-dot menu option.
    4. Google is integrating Circle to Search into Google Lens on iOS, improving usability but not achieving full system-wide access like on Android.
    5. Google Lens is receiving AI upgrades, providing users with AI-generated summaries and links related to the items they search for.

    Circle to Search has become one of Google’s notable triumphs lately. Initially, it was only available on Google and Samsung phones, but in late 2024, it started to spread to more Android devices. Now, Google is bringing this feature to Apple devices, although there are some significant restrictions.

    Functionality on Android

    On Android devices, Circle to Search is compatible with nearly all applications and screens. Users can easily activate it by long-pressing the navigation bar, after which they can circle, scribble, or tap on anything displayed to get more information.

    Limitations on iPhones

    On the other hand, iPhones have a much more limited experience. The feature is only found within the Google app and Chrome. Instead of the straightforward long-press action, users must tap the three-dot menu and choose “Search this Screen” to initiate a search.

    Integration with Google Lens

    Rather than fully transferring Circle to Search, Google is basically merging its capabilities into Google Lens as an additional feature for Chrome and the Google app on iOS. This makes sense since Lens has provided similar functions for a while, though users usually need to open the app and upload a screenshot to identify what they see on their screens. The latest update does streamline the process a bit, but it’s still not as user-friendly as it is on Android.

    Coming soon, a new Lens icon will be introduced to simplify access to this feature even further. However, complete system-wide integration like what exists on Android isn’t in the works for now.

    AI Upgrades for Google Lens

    In addition, Google Lens is getting enhanced with AI overviews. Now, when users search for something like a flower or a car using Google Lens, they will receive an AI-generated summary of the item, along with links to online resources related to it.

    This update is gradually being released to English-speaking users in regions where AI overviews are available.

    Google Launches Circle in Search for iPhones with Restrictions
    Tags: , ,
  • Google Lens Introduces Video and Voice Search Features

    Google Lens Introduces Video and Voice Search Features

    Google has introduced new voice and video search features for Google Lens during the I/O 2024 event back in May. Now users can easily long-press and ask questions using their voice, making the search process much simpler and more convenient.

    Custom Gemini Model Powers Video Search

    I/O event preview

    Enhanced Interaction with Google Lens

    Once Lens starts capturing video, users can pose questions about what they observe. For instance, when asked, “Why are they swimming together?” the Lens responded through Google Gemini. This video search capability allows users to present their phone with moving objects and inquire about them, enhancing the usefulness of Google Lens in various situations. To access this feature, users can participate in the “AI Overviews and more” experiment within Search Labs.

    Rajan Patel, Google’s vice president of engineering, explained how the feature operates. Google captures the video as a series of image frames, applying existing computer vision techniques used in Lens. Importantly, the responses are generated by a custom Gemini model designed to interpret multiple frames in sequence. Once the frames are processed, the model pulls relevant information from the web to formulate an answer.

    In conclusion, this development effectively utilizes existing technology, adding significant value to Google Lens.

    Image 1
    Tags: , ,
  • Access Circle to Search on Chrome Desktop Now Available

    Access Circle to Search on Chrome Desktop Now Available

    Google introduced the Circle to Search feature for select premium Android devices earlier this year in January. Currently, it has been expanded to desktop users as well, available in both ChromeOS and the Chrome browser. This feature facilitates easy searches based on visual content.

    Beta Availability

    Circle to Search is now accessible in the beta versions of ChromeOS and the Chrome browser for Windows and macOS. Specifically, it is available on ChromeOS 127 beta and Chrome 128 beta. It is anticipated to roll out to the general versions soon. The feature is named “Search with Google Lens” for Windows and macOS, whereas on ChromeOS, it is referred to as “Drag to Search.”

    Users on macOS or Windows with Chrome 128 beta can activate this feature by choosing “Search with Google Lens” from the overflow menu. This option can also be pinned to the side panel for quick access. On ChromeOS, users can initiate the feature by clicking the new Google Lens icon in the address bar.

    How It Works

    This feature allows desktop users to search for anything on their screen by simply dragging a box around the desired element. According to the release notes for Chrome 128 beta:

    “Google Lens in Chrome makes it easy to search anything you see on your screen. Search within a video you’re watching, a slide in a livestream, or an image on a webpage. Google Lens will give you answers right there, in your tab, and you can continue browsing with the new information you’ve found.”

    It’s expected that the feature will be included in the stable versions of Chrome for macOS and Windows in the next few weeks, making it accessible to all users as described.

    Tags: , ,