Apple’s iOS 18.1 beta 3 debuted on Wednesday, August 28, with a new Apple Intelligence tool called Clean Up that lets users remove unwanted objects from photos with the help of artificial intelligence (AI).
The third beta version of iOS 18.1 is part of a series of tests that the Cupertino-based tech company has conducted in preparation for the new operating system’s release. Developer accounts can download the system on their iPhone 15 Pro, iPhone 15 Pro Max, and all iPad and Mac models with ARM chips.
In addition to the latest version, Apple has offered another treat with the Clean Up tool. To use it, users simply need to select any image in the Photos app and tap the edit button. Then, the Clean Up option with the eraser icon appears. When clicked, it automatically highlights elements that can be tapped to be removed.
Apple leveraged multiple AI models to achieve smart detection, enabling the tool to precisely identify the edges of an object for easy isolation and calculate the fill the object should be replaced with. If something is not automatically detected, users can also circle or draw on any part of the photo.
Like any other changes in Photos, all Clean Up edits are reversible to restore the original image. Further, the metadata of an edited picture is added with a note to indicate AI use.
Still a hit-and-miss
Initial reviews from developers found that Clean Up works seamlessly when removing an object on a clear and uncluttered background. It also performs better at deleting smaller elements than removing an entire person.
When compared to existing AI-powered editing tools, it appears inferior in terms of replacing the removed item with realistic AI-generated content. X user @sondesix, for instance, has provided a comparison between the erasing capabilities of Clean Up and other tools, showing Google’s Magic Editor as a standout.
Magic Editor also offers different results and lets users pick the best one instead of relying on a single outcome just like Clean Up. However, Apple’s product also allows multiple iterations to enhance the edit.
Though still in its early testing phase, the hit-and-miss performance may be attributed to the fact that most Apple Intelligence features are built on-device. While this enhances privacy, this could also have limited their abilities since information is not sent to Apple’s servers.
Currently, Clean Up applies to all kinds of images, including screenshots, old photos, and photos taken using non-Apple devices. However, it is not available for videos. Using it on Live Photos can also be complicated since it turns off Live Photos, and users may lose their edit when they turn it back on.
Other updates
In addition to Clean Up, iOS 18.1 beta 3 also updated the notification summary feature. Originally only available for Mail and Messages, it now works on all third-party apps. This feature gives summaries of both multiple incoming messages and single notifications, perfect for users who do not have the time to scour each piece of information.
Moreover, third-party stickers can now be used in-line in the Messages app. Only stickers from Apple apps and Photos were previously allowed in previous betas of the operation system.
