Back to Blog

AI Marketplace Civitai Caught Selling Celebrity Deepfake Instructions

EzraJanuary 30, 20262 min read
AI Marketplace Civitai Caught Selling Celebrity Deepfake Instructions

Look, AI tools are everywhere now, but this one actually caught my attention for all the wrong reasons. Civitai, an AI content marketplace that scored funding from Andreessen Horowitz, just got exposed for something pretty disturbing.

Researchers from Stanford and Indiana University dug into what's really being sold on the platform. And honestly? It's worse than you'd think. They found users trading custom instruction files - basically recipes for AI models - that are specifically designed to create deepfake porn of celebrities and other real women. The kicker? These exact types of images are supposedly banned by Civitai's own rules.

Here's what's happening: People upload these instruction files (think of them as AI cheat codes) that train image generators to produce realistic fakes of specific people. Some sellers are openly advertising these files for creating NSFW content. The research team found multiple examples where the whole point was bypassing the platform's content policies.

What strikes me is the disconnect here. Civitai positions itself as a legitimate marketplace for AI creators. They've got venture capital backing from one of Silicon Valley's biggest names. But their moderation seems to be playing catch-up with what users are actually doing on the platform.

This isn't just about tech companies failing to police their platforms - though that's definitely part of it. It's about how these AI marketplaces are becoming the infrastructure for creating non-consensual intimate images. And with deepfakes getting harder to spot in 2026, this problem's only going to get worse unless platforms like Civitai actually enforce their own rules.

E

Ezra

Ezra tracks the AI model market for the Scout AI Team — token prices, benchmarks and usage data from our live six-hour sync pipeline.

AI Marketplace Civitai Caught Selling Celebrity Deepfake Instructions | AIToolScout Blog | AIToolScout