A fundamental problem in manifold learning is to approximate a functional relationship in a data chosen randomly from a probability distribution supported on a low dimensional sub-manifold of a high dimensional ambient Euclidean space. The manifold is essentially defined by the data set itself and, typically, designed so that the data is dense on the manifold in some sense. The notion of a data space is an abstraction of a manifold encapsulating the essential properties that allow for function approximation. The problem of transfer learning (meta-learning) is to use the learning of a function on one data set to learn a similar function on a new data set. In terms of function approximation, this means lifting a function on one data space (the base data space) to another (the target data space). This viewpoint enables us to connect some inverse problems in applied mathematics (such as inverse Radon transform) with transfer learning. In this paper we examine the question of such lifting when the data is assumed to be known only on a part of the base data space. We are interested in determining subsets of the target data space on which the lifting can be defined, and how the local smoothness of the function and its lifting are related.
翻译:流形学习中的一个基本问题是,在从概率分布中随机选取的数据上近似函数关系,该分布支撑于高维欧氏空间的低维子流形上。流形本质上由数据集本身定义,通常设计使得数据在某种意义下稠密分布于流形上。数据空间的概念是对流形的抽象,它封装了允许函数逼近的本质属性。迁移学习(元学习)问题旨在利用一个数据集上学习到的函数来学习新数据集上的类似函数。从函数逼近的角度看,这相当于将一个数据空间(基数据空间)上的函数提升到另一个数据空间(目标数据空间)上。这一视角使我们能够将应用数学中的某些逆问题(如逆拉东变换)与迁移学习联系起来。本文研究了当基数据空间上仅局部已知数据时此类提升问题的可能性。我们关注如何确定目标数据空间中可定义提升的子集,以及函数的局部光滑性与其提升之间的关系。