The paper establishes generalization bounds for multitask deep neural networks using operator-theoretic techniques. The authors propose a tighter bound than those derived from conventional norm based methods by leveraging small condition numbers in the weight matrices and introducing a tailored Sobolev space as an expanded hypothesis space. This enhanced bound remains valid even in single output settings, outperforming existing Koopman based bounds. The resulting framework maintains key advantages such as flexibility and independence from network width, offering a more precise theoretical understanding of multitask deep learning in the context of kernel methods.
翻译:本文利用算子理论方法建立了多任务深度神经网络的泛化界。通过利用权重矩阵的较小条件数并引入定制化的索伯列夫空间作为扩展假设空间,作者提出了比传统基于范数方法更紧的界。该增强界即使在单输出设置下仍然有效,且优于现有的基于Koopman的界。所得框架保持了灵活性和与网络宽度无关等关键优势,为核方法背景下的多任务深度学习提供了更精确的理论理解。