We propose Ruby Teaming, a method that improves on Rainbow Teaming by including a memory cache as its third dimension. The memory dimension provides cues to the mutator to yield better-quality prompts, both in terms of attack success rate (ASR) and quality diversity. The prompt archive generated by Ruby Teaming has an ASR of 74%, which is 20% higher than the baseline. In terms of quality diversity, Ruby Teaming outperforms Rainbow Teaming by 6% and 3% on Shannon's Evenness Index (SEI) and Simpson's Diversity Index (SDI), respectively.
翻译:我们提出Ruby Teaming方法,该方法在Rainbow Teaming基础上引入记忆缓存作为其第三个维度。记忆维度为变异器提供线索,从而生成在攻击成功率(ASR)和质量多样性两方面均更优的提示词。Ruby Teaming生成的提示词存档达到74%的攻击成功率,较基线提升20%。在质量多样性方面,Ruby Teaming在香农均匀度指数(SEI)和辛普森多样性指数(SDI)上分别比Rainbow Teaming高出6%和3%。