Hypergraphs are vital in modelling data with higher-order relations containing more than two entities, gaining prominence in machine learning and signal processing. Many hypergraph neural networks leverage message passing over hypergraph structures to enhance node representation learning, yielding impressive performances in tasks like hypergraph node classification. However, these message-passing-based models face several challenges, including oversmoothing as well as high latency and sensitivity to structural perturbations at inference time. To tackle those challenges, we propose an alternative approach where we integrate the information about hypergraph structures into training supervision without explicit message passing, thus also removing the reliance on it at inference. Specifically, we introduce Hypergraph-MLP, a novel learning framework for hypergraph-structured data, where the learning model is a straightforward multilayer perceptron (MLP) supervised by a loss function based on a notion of signal smoothness on hypergraphs. Experiments on hypergraph node classification tasks demonstrate that Hypergraph-MLP achieves competitive performance compared to existing baselines, and is considerably faster and more robust against structural perturbations at inference.
翻译:超图在建模包含两个以上实体的高阶关系数据中至关重要,并在机器学习和信号处理领域日益受到重视。许多超图神经网络利用超图结构上的消息传递来增强节点表示学习,在超图节点分类等任务中取得了显著性能。然而,这些基于消息传递的模型面临若干挑战,包括过平滑问题,以及在推理阶段的高延迟和对结构扰动的敏感性。为了解决这些挑战,我们提出了一种替代方法,将超图结构信息整合到训练监督中,无需显式的消息传递,从而在推理时消除对其的依赖。具体而言,我们引入了Hypergraph-MLP,一种面向超图结构数据的新型学习框架,其学习模型采用简单的多层感知机(MLP),通过基于超图信号平滑性概念的损失函数进行监督。在超图节点分类任务上的实验表明,Hypergraph-MLP与现有基线方法相比取得了具有竞争力的性能,同时在推理时速度显著更快且对结构扰动具有更强的鲁棒性。