Microsoft Expands Copilot Vision With Highlights on Windows, Can Work With Two Apps Simultaneously

Microsoft introduced the growth of Copilot Vision with Highlights to Windows on Wednesday. Initially, the brand new synthetic intelligence (AI) characteristic will solely be obtainable within the US, however the firm plans to deliver it to different areas quickly. It makes use of laptop imaginative and prescient and power use to analyse the content material on the person’s display and help them with queries. Copilot Vision was first unveiled by the Redmond-based tech large in December 2024, and in April, it was built-in inside the Microsoft Edge browser.

Copilot Vision on Windows Gets a New Highlights Feature

In a weblog publish, the tech large introduced that Copilot Vision is lastly being rolled out to Windows gadgets within the US. It shall be obtainable for each Windows 10 and Windows 11. The firm mentioned the characteristic shall be launched in additional non-European international locations quickly. Notably, Copilot Vision on Windows is a part of Copilot Labs.

Copilot Vision on Windows helps real-time voice, letting customers ask verbal queries concerning the content material. This model of the characteristic helps as much as two apps concurrently and may draw context from each screens on the identical time. This means customers can ask extra complicated questions, corresponding to, “Which image from my gallery goes well with the story I’ve written in Word?”

The new Highlights characteristic on this model will enable customers to command Copilot to indicate sure settings and different assistive assist. It can inform customers the place to click on and tips on how to navigate to an possibility. Sharing some examples of the use instances of the characteristic, Microsoft mentioned customers can ask Copilot to present suggestions whereas enjoying a recreation, ask it for assist to enhance the lighting in a photograph, or to evaluate a journey itinerary.

To use Copilot Vision on Windows, customers should open the Copilot app and click on the brand new glasses icon within the composer. Then, customers can choose the browser window or app they wish to share with the AI chatbot, and it might probably begin aiding them. To cease sharing the app or browser window, customers can press the X button within the composer. The firm highlighted that the characteristic is totally opt-in.