Microsoft’s latest Copilot updates include a mobile version of the multimodal Vision tool
Microsoft just announced several updates to its Copilot AI assistant, and some sound downright useful. It’s bringing Copilot Vision to mobile, but with some new features. For the uninitiated, this software originally launched for the Edge web browser and gave Copilot the ability to “see” and comment on the contents of websites.
The company is upping its game for the mobile version, adding some multimodal functionality. It’ll be able to integrate with your phone’s camera to “enable an interactive experience with the real world.” Microsoft says it can analyze both real-time video from the camera and photos stored on the device
Microsoft gives an example of Copilot Vision analyzing a video of plants to determine if they are healthy or not and suggesting actions to take. We’ll see if it can actually perform that kind of nuanced reasoning. Modern AI companies love to promise the world and then, well, you know the rest. In any event, the mobile version of Vision is available today in the Copilot app for iOS and Android. The web version is also coming to Windows.