Chrome takes a new step towards the intelligent browser
Web browsers no longer simply display web pages. They are gradually becoming genuine assistants capable of understanding the context in which users are working. With the new “Select from screen” feature, Google is continuing this transformation by allowing Gemini to analyse the elements visible on a web page directly. This development simplifies interactions with artificial intelligence and brings Chrome closer to a smarter, more intuitive working environment.
No more need to describe what you see
Until now, asking an AI for help often meant copying text, taking a screenshot or writing a description that could be long and imprecise. Google wants to eliminate this step with a much more natural approach.
With “Select from screen”, users can simply draw a box around an element visible in a Chrome tab, then ask Gemini about that content1. The assistant can thus directly analyse a paragraph, an image, a chart, a diagram or even a product photo.
This interaction is reminiscent of how Circle to Search works on Android, now adapted for the Chrome browser.
A much more natural interaction with AI
The novelty does not lie solely in visual selection. It reflects a deeper change in the way users communicate with intelligent assistants.
Instead of explaining what you want analysed, you now simply show the element in question. This approach reduces ambiguity, speeds up exchanges and improves the relevance of the answers generated by Gemini.
This multimodal approach is gradually becoming the norm among the leading artificial intelligence players.
A wide range of uses for professionals
Google envisages several use cases that go well beyond simply looking up information.
Users can, for example:
- ask for an explanation of a complex chart;
- compare several products displayed on the same page;
- analyse a technical image;
- summarise a document;
- turn content into a table or a list;
- get additional information about a visual element1.
The ability to keep several selections during the same session also makes it easier to compare different pieces of content.
Chrome is gradually becoming a work assistant
This feature illustrates an important shift in web browsers. Chrome is no longer used solely to look up information. It is becoming an environment capable of directly assisting users in their everyday tasks.
This approach is part of a broader Google strategy to put Gemini at the heart of all its products. After Android, Workspace and online search, the browser is also becoming a key interface for artificial intelligence.
A new step towards contextual AI
The arrival of this feature confirms the emergence of contextual AI. Unlike traditional assistants, Gemini no longer responds solely to text commands. It now takes into account the visual context in which the user is working in order to produce more relevant answers.
This capability is also one of the foundations of agentic AI, in which systems understand their environment before carrying out an action.
Simple activation for users
The feature is available from Chrome 149 onwards. Once the browser has been updated, simply open the Gemini panel via the “Ask Gemini” button, then use the “Select from screen” option available from the “+” menu1.
Users can then freely select one or more areas of the page before asking the assistant their questions.
Browsers are becoming a new AI platform
With this development, Google confirms that web browsers are gradually becoming a strategic platform for artificial intelligence. Having transformed online search, the company is now seeking to enrich the browsing experience directly with assistants capable of understanding what is displayed on screen.
This trend could permanently change professional practices, particularly in monitoring, documentation, training and data analysis.
Understanding intelligent interfaces is becoming essential
This development highlights an increasingly sought-after skill: designing interfaces that integrate artificial intelligence. Future IT professionals will need to understand how multimodal technologies, generative AI, data management and agentic AI interact to deliver more natural and more effective user experiences.
Chrome opens a new chapter in intelligent assistance
With “Select from screen”, Google is continuing to turn Chrome into a true digital assistant. For students and future digital professionals, this development illustrates an underlying trend: tomorrow, interfaces will no longer just ask users what they want to do; they will directly understand what they are looking at in order to assist them more effectively.
360° IT News — decoding technology to understand the jobs of tomorrow.
Further reading
The integration of Gemini into Chrome illustrates a major shift: everyday applications are gradually becoming able to understand the context in which their users operate. This contextual intelligence is transforming the way we interact with digital tools and paving the way for new professional uses. On a related topic, read our article “With iOS 27, Apple redesigns the user experience for the AI era”, which shows how Apple is also building artificial intelligence into the heart of its operating system to make interactions more natural and more personalised.
References
1. Google. (2026). Gemini in Chrome: Select from screen.
https://support.google.com/chrome
GitHub Copilot bulks up for business: coding agents come under IT control
Copilot is no longer just there to suggest the next line GitHub Copilot is continuing its transformation. Originally known mainly for completing code in the editor, the tool is now evolving towards agents capable of exploring a project, modifying files, using tools...
PDFs, presentations, audio: Adobe wants to turn Acrobat into a content factory
Acrobat no longer just wants to open your documents For more than thirty years, Acrobat has mainly been used to read, create, edit, sign and share PDFs. Adobe now wants to give it a much broader role. On 9 September 2026, the company announced new capabilities based...
Salesforce plugs Claude into its CRM: Claudeforce prepares for life after the interface
What if the CRM soon no longer needed to be opened? For decades, using a CRM meant navigating between customer records, dashboards, menus and forms. With Claudeforce, Salesforce and Anthropic want to change this logic: rather than forcing users to go into Salesforce...
Kimi K3, Mistral, DeepSeek: Oracle turns OCI into an AI model hub
Oracle wants to make OCI a one-stop shop for AI Oracle is stepping up its efforts in the AI cloud battle by significantly expanding the catalogue of models available in OCI Enterprise AI. On 4 September 2026, the group announced in particular the integration of Kimi...
Agentic Data Cloud: Google rethinks data for the age of AI agents
AI agents are forcing Google to rethink data architecture AI agents promise to search for information, make decisions and act directly within company systems, but this autonomy depends on one essential condition: accessing the right data and, above all, understanding...
Google Cloud tackles the hidden bill of AI agents
AI agents raise a new problem: how much does a task really cost? As companies move from chatbots to AI agents able to work through multiple steps, the question of cost becomes much more complex. A chatbot generally handles a request and generates an answer, whereas an...
Workday, Navan, Avalara: ChatGPT Work moves into business software
ChatGPT Work is gradually leaving the chat window With GPT-6 Astra, OpenAI is no longer simply trying to improve the quality of ChatGPT’s answers. The company wants to bring its AI closer to the applications in which employees actually work. With the arrival of GPT-6...
From chip to cloud: Groq raises 350 million to scale up
Groq now wants to sell cloud rather than just chips Groq is pursuing a major strategic transformation. Long seen as one of Nvidia’s challengers thanks to its LPUs (Language Processing Units) specialised in artificial intelligence model inference, the group is now...
Muse Code: Meta launches its AI agent to tackle giant codebases
Meta wants to bring AI agents into complex software projects Meta is stepping up its efforts in AI-assisted software development with Muse Code, a new agent designed to work on large codebases, where traditional assistants can quickly lose the context needed to...
Qwen3.8-Max reportedly coded for 16 days without human intervention
Alibaba tests how far an autonomous AI developer can go Alibaba claims to have reached a new milestone in agentic software development with Qwen3.8-Max, its new flagship model launched in early August 2026. In an internal test, the model reportedly worked fully...
