Matrix manifolds, such as manifolds of Symmetric Positive Definite (SPD) matrices and Grassmann manifolds, appear in many applications. Recently, by applying the theory of gyrogroups and gyrovector spaces that is a powerful framework for studying hyperbolic geometry, some works have attempted to build principled generalizations of Euclidean neural networks on matrix manifolds. However, due to the lack of many concepts in gyrovector spaces for the considered manifolds, e.g., the inner product and gyroangles, techniques and mathematical tools provided by these works are still limited compared to those developed for studying hyperbolic geometry. In this paper, we generalize some notions in gyrovector spaces for SPD and Grassmann manifolds, and propose new models and layers for building neural networks on these manifolds. We show the effectiveness of our approach in two applications, i.e., human action recognition and knowledge graph completion.
翻译:矩阵流形(如对称正定矩阵流形和格拉斯曼流形)在许多应用中频繁出现。近期,通过应用旋转群与旋转向量空间理论(一种用于研究双曲几何的强大框架),部分研究尝试在矩阵流形上构建欧几里得神经网络的原理性推广。然而,由于所考虑的流形在旋转向量空间中缺乏许多概念(例如内积与旋转角),这些研究提供的技术与数学工具相较于双曲几何领域仍存在局限。本文针对对称正定矩阵流形和格拉斯曼流形,推广了旋转向量空间中的若干概念,并提出了在这些流形上构建神经网络的新模型与层级结构。我们在人体动作识别与知识图谱补全两项应用中验证了本方法的有效性。