Apple removes apps that could create AI-generated nonconsensual nude images

App Store

With the rise in content generated by AI, there has been a lot of talk about its misuse. A few apps on Instagram were seen advertising creating nude images without users’ content. Apple has cracked down on these apps and has removed them from the App Store. According to a report by 404 media, there were some companies using ads on Instagram to promote apps that could “undress any girl for free.” These ads  took users to App Store directly to download the app. As per the report,

The report mentions that Apple didn’t directly comment on the story but did reach out to 404 Media seeking more information. 404 media then provided Apple direct links to the apps, which the company then removed.  As per the report, Apple had removed three apps from the App Store. The report mentions that this was possible only after 404 Media gave the company the links to specific apps. According to the report, Apple wasn’t able to find the apps that violated the App Store policies.

Apple’s App Store policies are strict but apps like these do sneak in. Apple’s App Store guidelines for developers clearly state “Apps should not include content that is offensive, insensitive, upsetting, intended to disgust, in exceptionally poor taste, or just plain creepy.”

Apple also has policy for “user-generated” content which says “Apps with user-generated content or services that end up being used primarily for pornographic content, Chatroulette-style experiences, objectification of real people (e.g. “hot-or-not” voting), making physical threats, or bullying do not belong on the App Store and may be removed without notice.”

While Apple has removed these three apps — with the help of the report — it does raise questions about how it plans to tackle problematic AI-generated content in apps.

Also read: Apple drops to fifth place in China’s smartphone market, claims Canalys report