Generative AI systems increasingly enable the production of highly realistic synthetic media. Civitai, a popular community-driven platform for AI-generated content, operates a monetized feature called Bounties, which allows users to commission the generation of content in exchange for payment. To examine how this mechanism is used and what content it incentivizes, we conduct a longitudinal analysis of all publicly available bounty requests collected over a 14-month period following the platform's launch. We find that the bounty marketplace is dominated by tools that let users steer AI models toward content they were not trained to generate. At the same time, requests for content that is "Not Safe For Work" are widespread and have increased steadily over time, now comprising a majority of all bounties. Participation in bounty creation is uneven, with 20% of requesters accounting for roughly half of requests. Requests for "deepfake" - media depicting identifiable real individuals - exhibit a higher concentration than other types of bounties. A nontrivial subset of these requests involves explicit deepfakes despite platform policies prohibiting such content. These bounties disproportionately target female celebrities, revealing a pronounced gender asymmetry in social harm. Together, these findings show how monetized, community-driven generative AI platforms can produce gendered harms, raising questions about consent, governance, and enforcement.
翻译:生成式人工智能系统正日益能够制作出高度逼真的合成媒体。Civitai作为一个广受欢迎的社区驱动型AI生成内容平台,运营着一项名为"Bounties"的付费功能,允许用户通过支付报酬委托生成特定内容。为探究该机制的使用方式及其激励产生的内容类型,我们对平台上线后14个月内收集的所有公开悬赏请求进行了纵向分析。研究发现,悬赏市场主要由能让用户引导AI模型生成其未经训练内容的工具主导。与此同时,"不适合工作场所"的内容请求普遍存在且持续增长,目前已占据所有悬赏请求的多数份额。悬赏创建参与度分布不均,20%的请求者贡献了约半数请求。针对"深度伪造"(描绘可识别真实个体的媒体)的请求比其他类型悬赏表现出更高的集中度。尽管平台政策禁止此类内容,仍有相当数量的请求涉及露骨的深度伪造内容。这些悬赏请求不成比例地针对女性名人,揭示了社会危害中显著的性别不对称现象。综合来看,这些发现表明商业化、社区驱动的生成式AI平台如何催生性别化危害,引发了关于同意机制、平台治理与政策执行的深刻问题。