Many real-world data are naturally represented as a sparse reorderable matrix, whose rows and columns can be arbitrarily ordered (e.g., the adjacency matrix of a bipartite graph). Storing a sparse matrix in conventional ways requires an amount of space linear in the number of non-zeros, and lossy compression of sparse matrices (e.g., Truncated SVD) typically requires an amount of space linear in the number of rows and columns. In this work, we propose NeuKron for compressing a sparse reorderable matrix into a constant-size space. NeuKron generalizes Kronecker products using a recurrent neural network with a constant number of parameters. NeuKron updates the parameters so that a given matrix is approximated by the product and reorders the rows and columns of the matrix to facilitate the approximation. The updates take time linear in the number of non-zeros in the input matrix, and the approximation of each entry can be retrieved in logarithmic time. We also extend NeuKron to compress sparse reorderable tensors (e.g. multi-layer graphs), which generalize matrices. Through experiments on ten real-world datasets, we show that NeuKron is (a) Compact: requiring up to five orders of magnitude less space than its best competitor with similar approximation errors, (b) Accurate: giving up to 10x smaller approximation error than its best competitors with similar size outputs, and (c) Scalable: successfully compressing a matrix with over 230 million non-zero entries.

翻译：许多真实世界的数据天然可表示为稀疏可重排矩阵，其行和列可任意排序（例如，二分图的邻接矩阵）。传统方式存储稀疏矩阵所需空间与非零元素数量呈线性关系，而稀疏矩阵的有损压缩（如截断SVD）通常需要与行数和列数成线性关系的空间。本文提出NeuKron方法，可将稀疏可重排矩阵压缩至恒定规模空间。NeuKron利用具有恒定数量参数的循环神经网络推广了Kronecker积。通过更新参数使给定矩阵被乘积近似，并重排矩阵的行列以促进近似过程，更新耗时与输入矩阵非零元素数量呈线性关系，每个元素的近似值可在对数时间内检索。我们还将NeuKron扩展至压缩稀疏可重排张量（如多层图），这是对矩阵的推广。在十个真实数据集上的实验表明，NeuKron具备以下特性：(a) 紧凑性：在相近近似误差下，所需空间比最佳竞争对手低五个数量级；(b) 准确性：在输出规模相同时，近似误差比最佳竞争对手低10倍；(c) 可扩展性：成功压缩包含超过2.3亿非零元素的矩阵。