Autoencoders have demonstrated remarkable success in learning low-dimensional latent features of high-dimensional data across various applications. Assuming that data are sampled near a low-dimensional manifold, we employ chart autoencoders, which encode data into low-dimensional latent features on a collection of charts, preserving the topology and geometry of the data manifold. Our paper establishes statistical guarantees on the generalization error of chart autoencoders, and we demonstrate their denoising capabilities by considering $n$ noisy training samples, along with their noise-free counterparts, on a $d$-dimensional manifold. By training autoencoders, we show that chart autoencoders can effectively denoise the input data with normal noise. We prove that, under proper network architectures, chart autoencoders achieve a squared generalization error in the order of $\displaystyle n^{-\frac{2}{d+2}}\log^4 n$, which depends on the intrinsic dimension of the manifold and only weakly depends on the ambient dimension and noise level. We further extend our theory on data with noise containing both normal and tangential components, where chart autoencoders still exhibit a denoising effect for the normal component. As a special case, our theory also applies to classical autoencoders, as long as the data manifold has a global parametrization. Our results provide a solid theoretical foundation for the effectiveness of autoencoders, which is further validated through several numerical experiments.

翻译：自编码器在多种应用中已展现出将高维数据学习为低维潜在特征的显著成功。假设数据采样自低维流形附近，我们采用图表自编码器，将数据编码为一组图表上的低维潜在特征，同时保持数据流形的拓扑与几何结构。本文建立了图表自编码器泛化误差的统计保证，并考虑$d$维流形上的$n$个带噪声训练样本及其无噪声对应样本，展示了其去噪能力。通过训练自编码器，我们证明图表自编码器能有效处理含正态噪声的输入数据去噪。在适当的网络架构下，我们证明图表自编码器可实现阶数为$\displaystyle n^{-\frac{2}{d+2}}\log^4 n$的平方泛化误差，该误差取决于流形的内蕴维度，且仅微弱依赖于环境维度和噪声水平。我们进一步将理论推广至同时包含法向与切向分量的噪声数据，其中图表自编码器仍对法向分量呈现去噪效果。作为特例，只要数据流形具有全局参数化，本理论同样适用于经典自编码器。我们的结果为自编码器的有效性提供了坚实的理论基础，并通过多项数值实验得到进一步验证。