This paper investigates the weaknesses of image watermarking techniques. We present WAVES (Watermark Analysis Via Enhanced Stress-testing), a novel benchmark for assessing watermark robustness, overcoming the limitations of current evaluation methods.WAVES integrates detection and identification tasks, and establishes a standardized evaluation protocol comprised of a diverse range of stress tests. The attacks in WAVES range from traditional image distortions to advanced and novel variations of adversarial, diffusive, and embedding-based attacks. We introduce a normalized score of attack potency which incorporates several widely used image quality metrics and allows us to produce of an ordered ranking of attacks. Our comprehensive evaluation over reveals previously undetected vulnerabilities of several modern watermarking algorithms. WAVES is envisioned as a toolkit for the future development of robust watermarking systems.

翻译：本文系统研究了图像水印技术的弱点。我们提出WAVES（通过增强压力测试的水印分析基准），这是一个评估水印鲁棒性的新型基准，克服了现有评估方法的局限性。WAVES整合了检测与识别任务，构建了包含多样化压力测试的标准化评估协议。其攻击类型涵盖传统图像失真到新型高级对抗攻击、扩散攻击及嵌入攻击变体。我们引入基于多种广泛使用图像质量指标的归一化攻击效能评分，从而建立攻击的排序分级框架。综合评估揭示了当前多种现代水印算法此前未被检测到的脆弱性。WAVES旨在成为未来鲁棒水印系统开发的工具包。