Some components of Microsoft’s Copilot assistant in Home windows 11 have felt like an answer looking for an issue—and it hasn’t helped that Microsoft has often modified Copilot’s capabilities, turning it from a local Home windows app into an online app and again once more.
However I discover myself intrigued by a brand new addition to Copilot Imaginative and prescient that Microsoft started rolling out this week to testers in its Home windows Insider program. Copilot Imaginative and prescient launched late final yr as a function that would have a look at pages within the Microsoft Edge browser and reply questions based mostly on these pages’ contents. The brand new Imaginative and prescient replace extends that functionality to any app window, permitting you to ask Copilot not simply concerning the contents of a doc but in addition concerning the person interface of the app itself.
Microsoft’s Copilot Imaginative and prescient replace can see the contents of any app window you share with it.
Credit score:
Microsoft
Offered the app works as supposed—not a given for any software program, however particularly for AI options—Copilot Imaginative and prescient might substitute “frantic Googling” as a method to discover ways to use a brand new app or the best way to do one thing new or obscure in complicated PC apps like Phrase, Excel, or Photoshop. I not too long ago switched from Photoshop to Affinity Photograph, for instance, and I am nonetheless discovering myself tripped up by small variations in workflows and UI between the 2 apps. Copilot Imaginative and prescient might, in idea, ease that kind of transition.
