At WWDC 2026, Apple introduced what it called the next generation of ‘Apple Intelligence’, describing it as a major shift in how AI is integrated across its ecosystem. Rather than treating AI as a standalone feature, Apple is embedding intelligence directly into its platforms through a new architecture built on Apple Foundation Models, which are deeply integrated into iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.
The new system is designed to make everyday apps and experiences more capable and context-aware across iPhone, iPad, Mac, Apple Watch, Apple Vision Pro, and other devices. It allows users to interact with their devices in a more natural way, where they can simply describe what they want and the system performs tasks across apps, generates content, and retrieves information from multiple sources like Messages, Mail, Photos, and system apps. Apple highlights that this capability is built with privacy at its core, combining on-device processing with Private Cloud Compute for more demanding tasks, while ensuring that personal data is neither stored nor accessible to Apple or third parties when processed in the cloud.
Photos App Upgrades
The next generation of Apple Intelligence also powers Siri AI, a redesigned assistant that is more conversational and context-aware. At the same time, the Photos app receives significant upgrades powered by more advanced image models, allowing users to perform high-level edits while preserving the integrity of the original image. A feature called ‘Spatial Reframing’ allows users to adjust the composition of a photo after it has been taken by virtually shifting perspective, with real-time previews that simulate repositioning the camera in the original scene. This capability is supported by Apple’s spatial computing expertise developed through Apple Vision Pro, and it ensures that only necessary parts of an image are regenerated when perspective changes.
Meanwhile, the Extend tool allows users to expand images beyond their original boundaries, like straightening horizons or changing aspect ratios while intelligently filling in missing content. The Clean Up tool has also been improved to remove unwanted objects more realistically, even in complex scenes. Apple stated that images edited using Apple Intelligence will include a hidden SynthID-style watermark to indicate AI involvement.
Safari Updates
Safari is also being improved with intelligence features that change how users browse the web. The browser can now automatically organize tabs into topic-based groups like travel planning or work projects, and it continues updating these groups dynamically as new tabs are added. A new capability called Notify Me allows Safari to monitor web pages for changes like price drops, restocks, or updates, sending alerts when relevant changes are detected. In addition, Apple Intelligence enables Passwords to automatically detect weak or compromised credentials and upgrade them securely on supported websites by navigating login flows autonomously. Safari also introduces a feature where users can describe desired functionality, and the system generates custom browser extensions directly in the toolbar, like tools for saving and rating recipes or customizing web interactions.
Image Playground
Even Apple’s Image Playground has been significantly upgraded with a new generative model capable of producing photorealistic images, running through Private Cloud Compute for higher computational demands. Users can generate and modify images using natural language or direct interaction methods like tapping, circling, or brushing areas of an image. These generated visuals can be used across system experiences like Messages, Lock Screen wallpapers, and Contact Posters, with support for different aspect ratios depending on the intended use case.
Messages, Mail & Call Upgrades
Communication and productivity tools across the system are also becoming more intelligent and context-aware. For example, in Messages, Apple Intelligence provides one-tap suggestions based on conversation context, like creating reminders, notes, or retrieving relevant photos by analyzing keywords, locations, and people. Mail gains improved smart replies that adapt to the user’s personal writing style and can trigger actions in third-party apps. A new Phone feature called Call Context can surface relevant information during calls, like confirmation codes or reservation numbers, by searching locally stored data in Mail or Messages, while ensuring all processing remains on-device.
Shortcuts app
The Shortcuts app becomes significantly more powerful with a new capability called Describe a Shortcut, which allows users to generate automation workflows simply by describing what they want. The system interprets the request and builds the required steps automatically, while also allowing users to refine or modify shortcuts through natural language. Apple Intelligence also extends into the smart home experience through the Home app, where it can group related notifications into a single ongoing activity rather than sending repeated alerts. It also generates descriptions of video footage captured by HomeKit Secure Video, allowing users to understand what happened in camera recordings without watching them.
Accessibility features receive major enhancements as well, with VoiceOver providing richer image descriptions and allowing users to ask questions about their surroundings through the Action Button on supported devices. Voice Control becomes more intuitive by allowing users to refer to interface elements in natural language rather than exact labels, while Accessibility Reader expands support for complex documents by offering summaries and translations. Across the system, Apple Intelligence introduces additional improvements like improved proofreading for spelling and grammar, smarter file and folder naming suggestions, and improvements to Genmoji for more flexible creation. Workout Buddy expands to additional languages and becomes available on Apple Watch even without the iPhone nearby.
The system will be available for developer testing immediately, followed by a public beta and a broader release in the fall with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27. It will support a wide range of languages including English, French, German, Spanish, Japanese, Korean, Chinese, and several others.
The Tech Portal is published by Blue Box Media Private Limited. Our investors have no influence over our reporting. Read our full Ownership and Funding Disclosure →
Ashutosh is a Senior Writer at The Tech Portal, largely reporting on new tech, and intersection of technology and business. Ashutosh’s career spans across nearly a decade of technology writing across multiple platforms and languages.
