Key takeaways
- Apple banned apps that masquerade as normal tools during review and then reveal nudify or other harmful features after approval, a practice known as bait-and-switch.
- The updated guidelines require apps hosting user-generated content to filter objectionable material, allow users to report abuse, and let users block problematic accounts.
- San Francisco City Attorney David Chiu's July order to remove nudify apps from both Apple and Google's stores appears to have influenced the stricter enforcement.
Apple has strengthened its App Store developer policies to combat a growing problem: applications that hide their true nature during the review process and only expose harmful capabilities after gaining approval. The Cupertino company rolled out the updated guidelines over the weekend, establishing clearer boundaries around artificial intelligence, offensive content, and deceptive submission practices.
What Apple Is Banning
Bait-and-switch nudify apps
The central target of the update is what the industry calls bait-and-switch tactics. Developers submit an application as, say, a photo editing tool or utility, pass Apple’s screening, and then update it after approval to activate features designed to generate nude images of people without consent. These “nudify” tools have proliferated across both iOS and Android, prompting intervention from regulators and public officials.
Apple stated that it “will remove apps that add features not present in the version submitted for App Store review.” The guideline now explicitly prohibits applications that “misrepresent their purpose during review and only reveal harmful capabilities — such as ‘nudification’ — after approval.” This language closes a loophole that bad actors had exploited to evade scrutiny.
AI-generated offensive content and hidden features
Beyond bait-and-switch schemes, Apple’s update confronts a wider issue: tools built on artificial intelligence that generate objectionable or abusive content. The revised guidelines prohibit “apps that use AI to create offensive content” and set expectations for how developers should police their platforms when users can add their own material.
For any application hosting user-generated content, Apple now requires three specific safeguards. Developers must filter objectionable material from display, provide users a mechanism to report offensive content, and implement blocking features so users can prevent certain accounts from contacting them. These protections align with rules Apple has applied sporadically in the past, but the update formalizes them and extends their reach.
Trafficking and child safety
The guidelines also reinforce existing language around child safety and human trafficking. Apple updated its legal section to make clear it will exclude apps that “promote human trafficking and exploitation of children.” While this echoes prior policy, the revision underscores Apple’s intent to keep such material off its platform.
How Apple Enforces Its Rules
Apple has positioned the App Store as a curated marketplace where human reviewers examine each submission. Last year, the company said its review process blocked more than 150,000 apps before they reached users. In the same period, Apple removed 193,000 developer accounts owing to fraud and abuse.
These numbers illustrate the scale of the problem Apple’s moderators face. The removal of nearly 200,000 accounts hints at organized or repeat offenders attempting to distribute harmful software. Yet the fact that Apple must block 150,000 submissions yearly indicates that bad actors continue to find ways around existing rules, making periodic updates to the guidelines necessary.
San Francisco’s Push for Accountability
Apple’s move comes after local officials escalated pressure on the tech industry. In July, San Francisco City Attorney David Chiu ordered both Apple and Google to remove nudification applications from their respective app stores. Chiu’s complaint centered on an uncomfortable truth: the companies had been profiting from the sale of these tools through their store commission fees, even as victims used similar apps to harass or harm others.
The accusation raised a question of corporate responsibility that extended beyond mere availability of an app. If a company knowingly hosted a category of software that allowed nonconsensual intimate imagery, was the company complicit? Chiu argued yes, suggesting that profit from abusive tools represented a form of complicity.
Earlier in the year, a Tech Transparency Project investigation found that both the Apple App Store and Google Play hosted multiple nudify applications, some of which Apple and Google had rated as appropriate for children. This finding magnified the urgency. Children using nudify tools, or becoming victims of them, represented a distinct harm that no app store should enable.
Impact on App Developers
The practical impact on app developers hinges on how strictly Apple enforces the new rules. For developers building legitimate tools, the update adds clarity around what Apple will and will not accept. An app that genuinely provides photo editing, for instance, should not be rejected for these guidelines, provided it does not transform into a nudify tool post-approval.
For developers building AI-powered applications, the guidelines now set a higher bar for content moderation. If an app relies on AI to generate or curate content, or allows users to contribute material, the developer must show Apple a plan for filtering harmful output and giving users controls. This could require additional engineering effort and moderation infrastructure.
The hidden features prohibition also applies beyond nudify apps. Any developer attempting to include undocumented or concealed functionality in their submission risks removal. This applies to data collection, behavior tracking, or capability that was not disclosed during review.
Looking Forward
The nudify app problem sits within a larger tension between innovation, free expression, and harm prevention. Artificial intelligence can generate images, and some tools use this capability to create nude versions of existing photographs. The technology itself is not inherently malicious, but its use cases range from consensual and harmless to deeply harmful.
Apple’s update suggests the company believes it can draw a line: allow AI-powered creativity, but prohibit AI designed to produce nonconsensual intimate images or other abusive material. Enforcement at that boundary is where the real challenge lies.
The guidelines also reflect a shift in how Apple justifies its app store policies. Rather than appeal to abstract concerns like “user experience” or “brand safety,” Apple now leans on concrete harms: the ability to create nonconsensual intimate imagery, the capacity to facilitate trafficking or child abuse. This language is harder for critics to dismiss as arbitrary censorship.
Whether Apple’s enforcement actually stops nudify apps and bait-and-switch submissions remains to be seen. Developers who have evaded app store rules in the past will likely adapt. But the updated guidelines at minimum establish a public commitment to the problem and a stated boundary that future moderation decisions can refer to.
Source: TechCrunch
Frequently Asked Questions
What is a bait-and-switch app?
A bait-and-switch app is submitted to the App Store as one type of application during review, passes approval, and is then updated post-approval to reveal harmful features such as nudification tools.
What content moderation safeguards did Apple require?
Apps that host user-generated content must filter objectionable material, provide users a way to report offensive content, and allow users to block abusive accounts.
Why did San Francisco's City Attorney focus on nudify apps?
David Chiu argued that Apple and Google were profiting from nudify app sales through store commission fees, and a Tech Transparency Project investigation found both platforms hosted nudify apps that were rated suitable for children.
