Generative AI systems increasingly enable the production of highly realistic synthetic media. Civitai, a popular community-driven platform for AI-generated content, operates a monetized feature called Bounties, which allows users to commission the generation of content in exchange for payment. To examine how this mechanism is used and what content it incentivizes, we conduct a longitudinal analysis of all publicly available bounty requests collected over a 14-month period following the platform's launch. We find that the bounty marketplace is dominated by tools that let users steer AI models toward content they were not trained to generate. At the same time, requests for content that is "Not Safe For Work" are widespread and have increased steadily over time, now comprising a majority of all bounties. Participation in bounty creation is uneven, with 20% of requesters accounting for roughly half of requests. Requests for "deepfake" - media depicting identifiable real individuals - exhibit a higher concentration than other types of bounties. A nontrivial subset of these requests involves explicit deepfakes despite platform policies prohibiting such content. These bounties disproportionately target female celebrities, revealing a pronounced gender asymmetry in social harm. Together, these findings show how monetized, community-driven generative AI platforms can produce gendered harms, raising questions about consent, governance, and enforcement.
翻译:生成式人工智能系统日益能够制作出高度逼真的合成媒体。Civitai作为一个广受欢迎的社区驱动型AI生成内容平台,运营着一个名为"悬赏"的货币化功能,允许用户通过支付报酬委托生成特定内容。为探究该机制的使用方式及其激励产生的内容类型,我们对平台上线后14个月内收集的所有公开悬赏请求进行了纵向分析。研究发现,悬赏市场主要由能让用户引导AI模型生成其未经训练内容的工具所主导。与此同时,"不适合工作场所"的内容请求广泛存在且持续增长,目前已占据所有悬赏请求的多数份额。悬赏创建的参与度分布不均,20%的请求者贡献了约半数请求。针对"深度伪造"(描绘可识别真实个体的媒体)的请求集中度显著高于其他悬赏类型。尽管平台政策明令禁止,仍有相当数量的此类请求涉及露骨的深度伪造内容。这些悬赏请求不成比例地针对女性名人,揭示了社会危害中显著的性别不对称现象。综合而言,这些发现表明货币化的社区驱动型生成式AI平台如何催生性别化危害,由此引发关于同意机制、平台治理与政策执行的重要议题。