It has become cognitive inertia to employ cross-entropy loss function in classification related tasks. In the untargeted attacks on graph structure, the gradients derived from the attack objective are the attacker's basis for evaluating a perturbation scheme. Previous methods use negative cross-entropy loss as the attack objective in attacking node-level classification models. However, the suitability of the cross-entropy function for constructing the untargeted attack objective has yet been discussed in previous works. This paper argues about the previous unreasonable attack objective from the perspective of budget allocation. We demonstrate theoretically and empirically that negative cross-entropy tends to produce more significant gradients from nodes with lower confidence in the labeled classes, even if the predicted classes of these nodes have been misled. To free up these inefficient attack budgets, we propose a simple attack model for untargeted attacks on graph structure based on a novel attack objective which generates unweighted gradients on graph structures that are not affected by the node confidence. By conducting experiments in gray-box poisoning attack scenarios, we demonstrate that a reasonable budget allocation can significantly improve the effectiveness of gradient-based edge perturbations without any extra hyper-parameter.
翻译:在分类相关任务中使用交叉熵损失函数已成为一种认知惯性。在针对图结构的无目标攻击中,攻击目标函数产生的梯度是攻击者评估扰动方案的依据。以往方法在攻击节点级分类模型时,常采用负交叉熵损失作为攻击目标。然而,交叉熵函数是否适合构建无目标攻击目标这一关键问题在先前研究中尚未得到探讨。本文从预算分配的角度论证了以往攻击目标的不合理性。我们从理论和实验两个层面证明:负交叉熵更倾向于从标注类别置信度较低的节点产生显著梯度,即使这些节点的预测类别已被误导。为释放这些低效攻击预算,我们提出一种基于新型攻击目标的简单攻击模型,该目标函数能生成不受节点置信度影响的非加权图结构梯度。通过在灰盒投毒攻击场景下开展实验,我们证明:合理的预算分配无需额外超参数即可显著提升基于梯度的边扰动攻击效果。