Text-to-Image (T2I) models have received widespread attention due to their remarkable generation capabilities. However, concerns have been raised about the ethical implications of the models in generating Not Safe for Work (NSFW) images because NSFW images may cause discomfort to people or be used for illegal purposes. To mitigate the generation of such images, T2I models deploy various types of safety checkers. However, they still cannot completely prevent the generation of NSFW images. In this paper, we propose the Jailbreak Prompt Attack (JPA) - an automatic attack framework. We aim to maintain prompts that bypass safety checkers while preserving the semantics of the original images. Specifically, we aim to find prompts that can bypass safety checkers because of the robustness of the text space. Our evaluation demonstrates that JPA successfully bypasses both online services with closed-box safety checkers and offline defenses safety checkers to generate NSFW images.

翻译：文本到图像（T2I）模型因其卓越的生成能力而受到广泛关注。然而，这些模型在生成不适合工作场所（NSFW）图像方面的伦理影响引发了担忧，因为NSFW图像可能引起人们不适或被用于非法目的。为了减少此类图像的生成，T2I模型部署了多种类型的安全检查器。然而，它们仍无法完全阻止NSFW图像的生成。本文提出越狱提示攻击（JPA）——一种自动攻击框架。我们的目标是保持能够绕过安全检查器的提示，同时保留原始图像的语义。具体而言，我们旨在寻找能够凭借文本空间的鲁棒性而绕过安全检查器的提示。我们的评估表明，JPA成功绕过了配备闭箱安全检查器的在线服务以及离线防御安全检查器，从而生成了NSFW图像。