We propose Hyper-Dimensional Function Encoding (HDFE). Given samples of a continuous object (e.g. a function), HDFE produces an explicit vector representation of the given object, invariant to the sample distribution and density. Sample distribution and density invariance enables HDFE to consistently encode continuous objects regardless of their sampling, and therefore allows neural networks to receive continuous objects as inputs for machine learning tasks, such as classification and regression. Besides, HDFE does not require any training and is proved to map the object into an organized embedding space, which facilitates the training of the downstream tasks. In addition, the encoding is decodable, which enables neural networks to regress continuous objects by regressing their encodings. Therefore, HDFE serves as an interface for processing continuous objects. We apply HDFE to function-to-function mapping, where vanilla HDFE achieves competitive performance as the state-of-the-art algorithm. We apply HDFE to point cloud surface normal estimation, where a simple replacement from PointNet to HDFE leads to immediate 12% and 15% error reductions in two benchmarks. In addition, by integrating HDFE into the PointNet-based SOTA network, we improve the SOTA baseline by 2.5% and 1.7% in the same benchmarks.
翻译:我们提出超维函数编码(Hyper-Dimensional Function Encoding, HDFE)。给定连续对象(例如函数)的样本,HDFE生成该对象的显式向量表示,且该表示对样本分布与密度具有不变性。样本分布与密度不变性使HDFE能够一致地编码连续对象,不受采样方式影响,从而允许神经网络将连续对象作为输入用于机器学习任务(如分类与回归)。此外,HDFE无需任何训练,且被证明能将对象映射至结构化嵌入空间,这有利于下游任务的训练。同时,该编码具有可解码性,使神经网络能够通过回归对象的编码来实现对连续对象的回归。因此,HDFE可作为处理连续对象的接口。我们将HDFE应用于函数到函数的映射任务,其原始版本即可达到与最新算法相媲美的性能。我们将HDFE应用于点云表面法向估计,在两项基准测试中,简单地将PointNet替换为HDFE即可分别降低12%和15%的误差。此外,通过将HDFE集成到基于PointNet的最优网络(SOTA)中,我们在相同基准测试上进一步提升了2.5%和1.7%的基线性能。