Microsoft is rolling out an update for Copilot Vision to Windows Insiders, enabling the AI tool to scan an entire screen. This expands its previous capability of analyzing two applications concurrently, allowing it to view the full desktop or specific browser/app windows.
Unlike the Recall feature, which automatically captures periodic snapshots of a computer screen, Copilot Vision operates similarly to screen sharing in a video call. Users activate the feature by selecting a glasses icon within the Copilot application and choosing the desired desktop for the AI to view. This interaction requires direct user initiation.
Microsoft states that Copilot Vision is designed to “help analyze content, provide insights, and answer your questions, coaching you through it aloud.” The company has provided examples of its potential applications, including offering guidance on improving creative projects, assisting with resume enhancements, and providing support for navigating new video games. This functionality aims to offer real-time, context-aware assistance.
Microsoft initiated testing for Copilot Vision last year. Initially, the feature focused on analyzing content viewed while browsing the web within the Edge browser. Furthermore, Copilot Vision possesses the capability to respond to user inquiries based on visual information captured through a mobile phone’s camera, extending its utility beyond desktop environments.
