Graph neural networks based on message-passing mechanisms have achieved advanced results in graph classification tasks. However, their generalization performance degrades when noisy labels are present in the training data. Most existing noisy labeling approaches focus on the visual domain or graph node classification tasks and analyze the impact of noisy labels only from a utility perspective. Unlike existing work, in this paper, we measure the effects of noise labels on graph classification from data privacy and model utility perspectives. We find that noise labels degrade the model's generalization performance and enhance the ability of membership inference attacks on graph data privacy. To this end, we propose the robust graph neural network approach with noisy labeled graph classification. Specifically, we first accurately filter the noisy samples by high-confidence samples and the first feature principal component vector of each class. Then, the robust principal component vectors and the model output under data augmentation are utilized to achieve noise label correction guided by dual spatial information. Finally, supervised graph contrastive learning is introduced to enhance the embedding quality of the model and protect the privacy of the training graph data. The utility and privacy of the proposed method are validated by comparing twelve different methods on eight real graph classification datasets. Compared with the state-of-the-art methods, the RGLC method achieves at most and at least 7.8% and 0.8% performance gain at 30% noisy labeling rate, respectively, and reduces the accuracy of privacy attacks to below 60%.
翻译:基于消息传递机制的图神经网络在图分类任务中取得了先进成果。然而,当训练数据中存在噪声标签时,其泛化性能会下降。大多数现有的噪声标签处理方法集中于视觉领域或图节点分类任务,且仅从效用角度分析噪声标签的影响。与现有工作不同,本文从数据隐私和模型效用两个维度衡量噪声标签对图分类的影响。我们发现噪声标签会降低模型的泛化性能,并增强针对图数据隐私的成员推断攻击能力。为此,我们提出了一种针对含噪声标签图分类的鲁棒图神经网络方法。具体而言,首先通过高置信度样本和每类第一特征主成分向量精确过滤噪声样本;其次,利用鲁棒主成分向量与数据增强下的模型输出,实现由双重空间信息引导的噪声标签校正;最后,引入监督图对比学习以增强模型的嵌入质量并保护训练图数据的隐私。通过在八个真实图分类数据集上对比十二种不同方法,验证了所提方法的效用与隐私性。与最先进方法相比,RGLC方法在30%噪声标签率下实现了最高7.8%、最低0.8%的性能提升,并将隐私攻击的准确率降低至60%以下。