Microsoft Rolls Out AI-Focused Features in Windows 11 24H2 Update
Microsoft is set to release the Windows 11 24H2 update, bringing a variety of enhancements, particularly for users of the recently introduced Copilot+ PCs. Standard hardware users can expect minor tweaks, but the Copilot+ devices will see significant AI-focused features, leveraging built-in neural processing units (NPUs) for localised AI tasks.
Gradual, Staggered Release
The new features will initially be available to members of the Windows Insider Program. In October, users of Qualcomm-powered Arm devices will receive the update, with a broader rollout in November to Copilot+ PCs featuring Intel’s Core Ultra CPUs and AMD’s Ryzen AI hardware. These phased releases ensure that the features are tested and refined before general public availability.
AI Capabilities
Recall (Preview) Recall aims to give PCs a "photographic memory," capturing and organising information for easy retrieval. Initially planned for release in June, it was postponed due to privacy concerns. Now, Microsoft has integrated features like virtualization-based security filters to prevent sensitive data collection. Recall will be disabled by default, allowing users to opt-in.
Click To Do (Preview) This feature integrates AI-based actions into a shortcut menu accessible over images or text. For instance, after taking a screenshot, users can press the Windows key and right-click for options to blur backgrounds or erase objects from photos. Text options include rewriting or summarising content.
Fuzzy Windows Search Improvements to Windows Search aim to make it less literal, accommodating descriptions of files or settings regardless of exact names or correct syntax. The feature also handles spelling errors and searches both local and OneDrive-stored content. Initially limited to File Explorer's search box, it will eventually extend to Windows Search and Settings.
Photos and Paint Enhancements Two key apps integrated with Windows will also receive updates. The Photos app introduces "Super Resolution," capable of enhancing old, low-resolution photos up to 8X using the NPU. The Paint app will gain generative fill and erase features to modify images by adding or removing elements as needed.
Copilot Features
Microsoft has redesigned the Copilot AI companion to be more engaging and supportive. It aims to provide users with a sense of being "smarter and more supported" through natural conversations. Available across various platforms including iOS, Android, and web, Copilot will feature Copilot Voice, providing four voice options for interaction, and Copilot Daily, a personalised news and weather briefing.
Additionally, Copilot Discover presents personalised cards from chat history as conversation starters, while Microsoft Edge users can utilize Copilot features using the @copilot shortcut.
Experimental Features in Copilot Labs
Copilot Vision and Think Deeper Exclusive to paid subscribers, Copilot Vision allows real-time discussion with the AI about web page contents. Microsoft emphasises that no data from these interactions is stored or used for training, addressing privacy concerns. The feature will interact only with certain websites and exclude paywalled or sensitive content. The Think Deeper feature aims to assist with complex queries, including difficult maths problems.
These new features, beginning their rollout in selective markets, underscore Microsoft's focus on integrating advanced AI capabilities into its operating system, promising enhanced productivity and user engagement.
Source: Noah Wire Services