Gemini Update in Chrome: New Features for Enhanced Browsing

The latest update to Gemini in Chrome brings exciting new features that integrate more Gemini capabilities within the browser for Windows, MacOS, and Chromebook Plus. These features include an AI side panel, agentic AI Auto Browse, and Nano Banana image editing, making browsing more efficient and enjoyable.

Introduction to the New Features

The update adds three new features that work together to provide a more seamless and personalized browsing experience. The AI side panel allows users to multitask more easily, while the agentic AI Auto Browse enables users to automate tasks such as researching and comparing prices. The Nano Banana image editing feature allows users to edit images directly in the browser window.

AI Side Panel for Multitasking

The new AI side panel in Chrome enables users to slide open a panel and interact with Gemini without having to switch between tabs. This feature is designed to save time and make multitasking easier. According to Google, testers have used the feature for a variety of tasks, including comparing options across multiple tabs, summarizing product reviews, and finding time for events in busy calendars.

Opt-In Requirement for AI Chat

Before using the AI side panel, users must first consent to sending their URLs and browser data to Google. This is an important step to ensure that users are aware of how their data is being used.

Screenshot of Opt-In Form

A screenshot of the opt-in form shows the clear and concise language used to explain the data sharing requirements.

Nano Banana in Chrome

The Nano Banana feature allows users to edit images directly in the browser window using the AI side panel. This means that users can update and change images without having to download, upload, or copy them.

Chrome Autobrowse (Agentic AI)

The agentic AI Auto Browse feature is available to subscribers of Google’s AI Pro and Ultra tiers. This feature enables an AI agent to take action on behalf of the user, such as researching hotel and flight prices, obtaining quotes for work, and checking if bills are paid. The AI agent can also identify items in a photo and find where they can be purchased, adding them to a cart and applying discount codes if necessary.

Additional Features and Upgrades

Google has also announced that Chrome’s AI has been upgraded with app connections, allowing it to connect to Calendar, Gmail, Google Shopping, Google Flights, Maps, and YouTube. This is part of Google’s Personal Intelligence initiative, which aims to provide a more personalized AI assistant.

Personalization and User Intent Extraction for AI Chat and Agents

Google has also published a research paper on a new method for extracting user intent, which can be used to provide better personalized and proactive responses. This technology has the potential to revolutionize the way we interact with AI chat and agents.

Conclusion

The latest update to Gemini in Chrome brings a range of exciting new features that enhance the browsing experience. From the AI side panel to the agentic AI Auto Browse and Nano Banana image editing, these features work together to provide a more seamless, efficient, and personalized browsing experience. As Google continues to develop and refine its AI technology, we can expect to see even more innovative features in the future.