Apple may soon introduce on-device and cloud-based AI features to iOS 18 for the iPhone 16 series, following in the footsteps of Google, Samsung, Huawei, and other Android OEMs. The heart of Apple's AI strategy for iOS 18, known as Project Greymatter, will integrate these features across core apps and services like Safari, Notes, and Photos.
New AI Features in iOS 18
One of the standout features is 'Greymatter Catch Up,' a notification summarization tool that allows users to listen to summaries of recent notifications via Siri. Additionally, Apple plans to introduce AI-powered photo editing and other features.
iOS 18 Generative Playground
Apple is reportedly working on a new object-erasing photo editing feature. This generative AI tool can recognize and remove unwanted objects from images, filling the space with AI-generated content that blends seamlessly with the surroundings. This feature is similar to what is already available on Pixel, Galaxy, and Huawei devices.
Apple has also developed an "internal application" called Generative Playground, which may allow users to experience this AI-powered photo editing feature. This tool might be integrated into iMessage for easy sharing. iOS 18 could also offer the capability to generate personalized emojis.
The new operating system will include an automated response generation feature based on large language models (LLMs). This feature will intelligently consider factors like names, calendar events, locations, and times when generating responses. Siri is also being improved to offer more natural and smooth text-to-speech functionality for a better user experience.
Major Improvements to the Notes App
The Notes app will receive a significant upgrade with iOS 18 and macOS 15, incorporating text-based generative AI capabilities like speech-to-text conversion and summarization. Users will be able to record audio directly from the Notes app, convert it to text, and summarize it. This could make it easier to access information from an entire meeting or lecture.
Apple is expected to announce these developments at the upcoming WWDC conference, which will take place from June 10 to June 14.
