Quantum machine learning models have shown successful generalization performance even when trained with few data. In this work, through systematic randomization experiments, we show that traditional approaches to understanding generalization fail to explain the behavior of such quantum models. Our experiments reveal that state-of-the-art quantum neural networks accurately fit random states and random labeling of training data. This ability to memorize random data defies current notions of small generalization error, problematizing approaches that build on complexity measures such as the VC dimension, the Rademacher complexity, and all their uniform relatives. We complement our empirical results with a theoretical construction showing that quantum neural networks can fit arbitrary labels to quantum states, hinting at their memorization ability. Our results do not preclude the possibility of good generalization with few training data but rather rule out any possible guarantees based only on the properties of the model family. These findings expose a fundamental challenge in the conventional understanding of generalization in quantum machine learning and highlight the need for a paradigm shift in the study of quantum models for machine learning tasks.
翻译:量子机器学习模型即使在少量数据训练下,也展现出成功的泛化性能。在本工作中,通过系统性随机化实验,我们表明传统的泛化理解方法无法解释此类量子模型的行为。我们的实验揭示:最先进的量子神经网络能够精确拟合随机态以及训练数据的随机标注。这种记忆随机数据的能力违背了当前关于小泛化误差的观念,对基于VC维、Rademacher复杂度及其所有一致相关性等复杂度度量方法构成质疑。我们通过理论构造补充了实证结果,表明量子神经网络能够将任意标签拟合到量子态,这暗示了其记忆能力。我们的结果并不排除少量训练数据下良好泛化的可能性,而是排除了仅基于模型族特性的任何可能保证。这些发现揭示了传统量子机器学习泛化认知中的根本性挑战,并凸显了量子模型在机器学习任务研究中需要范式转变的必要性。