Spatial reasoning in text plays a crucial role in various real-world applications. Existing approaches for spatial reasoning typically infer spatial relations from pure text, which overlooks the gap between natural language and symbolic structures. Graph neural networks (GNNs) have showcased exceptional proficiency in inducing and aggregating symbolic structures. However, classical GNNs face challenges in handling multi-hop spatial reasoning due to the over-smoothing issue, i.e., the performance decreases substantially as the number of graph layers increases. To cope with these challenges, we propose a novel Depth-Wise Graph Neural Network (DepWiGNN). Specifically, we design a novel node memory scheme and aggregate the information over the depth dimension instead of the breadth dimension of the graph, which empowers the ability to collect long dependencies without stacking multiple layers. Experimental results on two challenging multi-hop spatial reasoning datasets show that DepWiGNN outperforms existing spatial reasoning methods. The comparisons with the other three GNNs further demonstrate its superiority in capturing long dependency in the graph.
翻译:空间推理在文本处理中对于多种实际应用至关重要。现有空间推理方法通常从纯文本中推断空间关系,忽略了自然语言与符号结构之间的鸿沟。图神经网络(GNN)在归纳和聚合符号结构方面展现出卓越能力。然而,传统GNN在处理多跳空间推理时面临过度平滑问题的挑战,即随着图网络层数增加,性能显著下降。为应对这些挑战,我们提出了一种新型深度图神经网络(DepWiGNN)。具体而言,我们设计了一种新颖的节点记忆方案,沿图的深度维度而非广度维度聚合信息,从而能够在无需堆叠多层的情况下收集长程依赖关系。在两项具有挑战性的多跳空间推理数据集上的实验结果表明,DepWiGNN优于现有空间推理方法。与其他三种GNN的对比进一步证明了其在捕获图中长程依赖关系方面的优越性。