Microsoft Upgrades Copilot Vision to Scan Everything on Your Screen
Microsoft has announced a major update to Copilot Vision, expanding its capabilities beyond just two applications. With this rollout to Windows Insiders, the AI assistant can now view your entire desktop or any selected browser or app window. This marks a significant change from earlier versions, which were limited to viewing and interpreting content from just two apps side by side.
This improvement brings Copilot Vision closer to functioning like a video call screen share. You must manually activate it by clicking the glasses icon in the Copilot app and choosing which screen to display. Unlike Microsoft’s Recall feature, which takes regular screen snapshots automatically, this method ensures user control over when and what is shared.
Although it doesn’t record, Copilot Vision can actively respond to what it sees. Because of this, users may find it particularly helpful during tasks like editing creative projects, refining resumes, or learning new games.
A More Engaged AI Assistant
Microsoft explains that Copilot Vision can now “help analyze content, provide insights, and answer your questions, coaching you through it aloud.” This kind of interaction creates a more dynamic experience. For example, if you’re designing something or reviewing a document, the tool can suggest improvements instantly.
While this functionality seems similar to how AI can support real-time collaboration, it offers a more personalized interaction. And since you choose when to enable the feature, privacy remains largely in your hands.
Expanding Beyond the Desktop
Microsoft first introduced Copilot Vision last year, but in a more limited form. Initially, it worked only within the Edge browser. Gradually, Microsoft extended support to mobile use cases as well. Now, the tool can even respond to visual input from your phone’s camera.
This evolution shows Microsoft’s broader vision: AI that doesn’t just process language but also understands what you’re seeing. As Copilot Vision continues to grow, it could become a standard digital assistant not just for work, but also for daily personal use.
