The evolution of artificial intelligence (AI) has catalyzed a transformation in digital content generation, with profound implications for cyber influence operations. This report delves into the potential and limitations of generative deep learning models, such as diffusion models, in fabricating convincing synthetic images. We critically assess the accessibility, practicality, and output quality of these tools and their implications in threat scenarios of deception, influence, and subversion. Notably, the report generates content for several hypothetical cyber influence operations to demonstrate the current capabilities and limitations of these AI-driven methods for threat actors. While generative models excel at producing illustrations and non-realistic imagery, creating convincing photo-realistic content remains a significant challenge, limited by computational resources and the necessity for human-guided refinement. Our exploration underscores the delicate balance between technological advancement and its potential for misuse, prompting recommendations for ongoing research, defense mechanisms, multi-disciplinary collaboration, and policy development. These recommendations aim to leverage AI's potential for positive impact while safeguarding against its risks to the integrity of information, especially in the context of cyber influence.

翻译：人工智能（AI）的演进推动了数字内容生成的变革，对网络影响力行动产生了深远影响。本报告深入探讨了扩散模型等生成式深度学习模型在伪造逼真合成图像方面的潜力与局限性。我们从可获取性、实用性和输出质量三个维度对这些工具进行了批判性评估，并分析了其在欺骗、影响和颠覆等威胁场景中的影响。值得注意的是，本报告生成了若干假设性网络影响力行动的内容，以展示当前AI驱动方法对威胁行为者的能力与限制。尽管生成式模型在插画及非写实图像制作方面表现出色，但创造令人信服的照片级真实内容仍面临重大挑战——受限于计算资源以及人工引导修正的必要性。我们的探索凸显了技术进步与其被滥用可能性之间的微妙平衡，为此提出了包括持续研究、防御机制、多学科协作及政策制定在内的相关建议。这些建议旨在发挥AI的积极潜力，同时防范其对信息完整性的风险，特别是在网络影响力领域的应用场景中。