Unlocking Productivity: Microsoft Tests New Copilot Vision Update that ‘Sees’ Your Screen and Apps

Microsoft is rolling out exciting new features for its Copilot app on Windows. The latest update introduces Copilot Vision, which allows users to share their screens or apps with this AI assistant. Originally available only in the Edge browser, Copilot Vision is now set to expand to all applications on your PC.

With Copilot Vision, users can get real-time help. For instance, it can guide you through features in Adobe Photoshop or analyze images and web pages you’re working with. I had a sneak peek at this feature during Microsoft’s 50th anniversary celebration, where Copilot helped me play Minecraft and optimize settings in Clipchamp, their video editor.

Currently, these features are being tested with Windows Insiders in the U.S. That means not everyone can try them out just yet. When fully operational, Copilot can highlight parts of your screen, making it easier to follow along with its guidance. This functionality is expected to enhance productivity significantly, similar to how screen sharing works during a Microsoft Teams call.

Another exciting addition is the file search capability. Users can now ask Copilot about the contents of different file types—like .docx, .xlsx, .pptx, .txt, .pdf, and .json—making it simpler to locate documents you’ve recently accessed.

Both Copilot Vision and file search will be available to all Windows 11 users soon, not just those with high-end PCs. You can also access Copilot Vision on mobile devices, both iOS and Android.

These innovations align with a growing trend in enhancing user experience through AI. As technology evolves, tools like Copilot demonstrate how AI can assist in daily tasks, making our workflows smarter and more efficient.

For those curious about the current landscape of AI in technology, a recent survey by McKinsey reveals that 50% of companies are using AI in at least one business function, highlighting AI’s increasing relevance across various sectors.

As Microsoft continues to refine these tools, it will be exciting to see how they shape our interactions with technology in the future.

Check out this related article: Is HDMI on the Decline? Discover Everything You Need to Know About GPMI’s Game-Changing Impact!