cyberivy
AI SafetyDeepfakesPlatform RegulationAppleGoogleApp StoresPrivacyTech Policy

San Francisco pushes Apple and Google to act on nudify apps

July 18, 2026

Ein Smartphone mit App-Symbolen liegt neben einem Laptop, während eine Person den Bildschirm prüft.

San Francisco's city attorney is demanding that Apple and Google remove 13 AI apps from their stores. The case shows deepfake abuse is also a platform-liability issue.

What this is about

San Francisco has sent cease-and-desist letters to Apple and Google demanding that 13 so-called face-swap or nudify apps be removed from their app stores. The letters were sent on July 16, 2026 and reported by several outlets on July 17, 2026. The allegation is serious: the platforms are not merely hosting problematic tools, but may also be earning fees through app-store payments tied to services that can create non-consensual intimate deepfakes.

This is more than another moderation story. Until now, many enforcement efforts focused on individual deepfake websites. This case targets the larger distribution layer: app review, search, payments, developer accounts, and whether a store is doing enough when a tool marketed as harmless image editing is used in practice for sexual abuse.

What the nudify-app action actually does

According to reports, the city attorney wants Apple and Google to end business relationships with the affected developers, remove the apps, and strengthen review systems. WIRED reports that the list covers eight apps in the App Store and five in Google Play. Some present themselves as general face-swap tools, but can generate sexualized or undressing images after a user uploads a photo.

Google told WIRED it had already removed hundreds of apps with nudifying features and restricted related searches. Apple said three of the named apps had been removed and other developers were under review. That is the central tension: the companies say their rules already ban this content. San Francisco argues that repeated warnings, revenue, and continuing availability show that enforcement is not enough.

Why it matters

Non-consensual intimate deepfakes are no longer a fringe problem. The Tech Transparency Project repeatedly reported apps in major stores in 2026 that enabled this kind of content for payment. WIRED also points to research from Cornell University and Georgetown University: in a sample of 155 face-swap apps, 70 percent could be used for nude-image face swaps, even though many were not openly marketed as nudify apps.

For ordinary users, the point is blunt: abuse does not only start in obscure forums. It can run through polished app-store pages, in-app purchases, and search. For platforms, the risk question shifts from “Do we have a rule?” to “Can we detect evasion, dual-use features, and payment flows quickly enough?”.

In plain language

Imagine a hardware store selling a tool officially labeled as a “picture-frame opener,” while customers mostly use it to break into other people's doors. If customers, police, and neighbors warn the store again and again, a sign saying “Use legally” is no longer enough.

That is the app-store question. Stores are not just neutral shelves. They rank, recommend, process payments, and decide which developers can reach billions of devices.

A practical example

A school with 900 students discovers 18 manipulated images in group chats on a Monday morning. The images did not come from a specialist forum, but from an app listed in a store as a “fun face-swap” product. Three teenagers paid $4.99 each for credits, uploaded photos, and shared the outputs.

For the school, this is not an abstract AI debate. It becomes crisis work: notifying affected students, preserving evidence, involving parents, contacting platforms, calling police, and offering psychological support. If the store kept the app visible and payable despite earlier warnings, an individual incident becomes an infrastructure problem.

Scope and limits

First, not every face-swap app is harmful by default. Many tools are used for harmless effects, accessibility, film production, or design. What matters is safeguards, usage patterns, moderation, and the concrete ability to create intimate images without consent.

Second, the source base for the cease-and-desist letters is mainly journalistic. Reports quote the letters and company statements, but the full letters were not available as a public agency PDF when this article was written.

Third, app-store removal will not solve the entire problem. Operators can move to websites, bots, or alternative stores. Even so, the step matters because major stores provide reach, trust, and payment rails.

SEO & GEO keywords

San Francisco City Attorney, David Chiu, Apple App Store, Google Play Store, Nudify Apps, nonconsensual intimate deepfakes, Deepfake Regulation, Tech Transparency Project, AI Safety, Platform Liability, California Law

💡 In plain English

San Francisco wants Apple and Google to take more responsibility because AI apps can create intimate deepfakes. The case shows that abuse is not only about the app developer, but also about the store that provides reach and payments.

Key Takeaways

  • San Francisco is asking Apple and Google to remove 13 AI nudify apps from their stores.
  • The apps are often marketed as face-swap tools, but can create intimate deepfakes.
  • WIRED reports that Apple and Google have already removed some apps.
  • Research on face-swap apps shows a clear dual-use risk.
  • The case shifts the debate from model abuse to platform responsibility.

FAQ

Sources & Context