Microsoft Starts Testing Copilot Vision Update That Can “see” Your Screen And Apps

Microsoft has started testing a caller update to its Copilot app connected Windows that will fto you stock your surface aliases apps pinch nan AI assistant. Copilot Vision was originally limited to Microsoft’s Edge browser, but it’s now extending to immoderate app connected your PC.

Copilot Vision will beryllium capable to do things for illustration coach you done utilizing Adobe Photoshop features, aliases analyse nan photos and webpages you’re looking at. I sewage to spot an early type of Copilot Vision connected Windows astatine Microsoft’s 50th day statement past week, wherever nan AI adjunct guided maine done a crippled of Minecraft and helped to optimize settings successful Microsoft’s Clipchamp video editor.

I haven’t been capable to afloat trial Copilot Vision connected Windows done nan Insider beta because Microsoft is limiting nan acquisition to US testers only. Copilot will beryllium capable to item parts of your surface to guideline you done apps, though this first beta type won’t person nan characteristic enabled conscionable yet. Copilot Vision mightiness sound akin to Microsoft’s Recall characteristic that automatically takes snapshots if you let it, but it’s really much for illustration surface sharing an app aliases your full desktop successful a Microsoft Teams call.

Microsoft has besides started testing record hunt successful Copilot connected Windows, allowing you to inquire nan AI adjunct astir nan contents of a record connected your PC. File hunt supports .docx, .xlsx, .pptx, .txt, .pdf, .json files, and you tin usage Copilot to easy find nan documents you were moving connected recently.

Both of these Copilot features conscionable require nan Copilot app connected Windows, and not a afloat Copilot Plus PC. You tin besides usage Copilot Vision connected iOS and Android. Microsoft has started testing these caller Copilot features pinch Windows Insiders, up of a broader rollout to each Windows 11 users successful nan coming weeks aliases months.