Physically informed neural networks (PINNs) are a promising emerging method for solving differential equations. As in many other deep learning approaches, the choice of PINN design and training protocol requires careful craftsmanship. Here, we suggest a comprehensive theoretical framework that sheds light on this important problem. Leveraging an equivalence between infinitely over-parameterized neural networks and Gaussian process regression (GPR), we derive an integro-differential equation that governs PINN prediction in the large data-set limit -- the neurally-informed equation. This equation augments the original one by a kernel term reflecting architecture choices and allows quantifying implicit bias induced by the network via a spectral decomposition of the source term in the original differential equation.
翻译:物理信息神经网络(PINNs)是一种求解微分方程的有前途的新兴方法。与许多其他深度学习方法一样,PINN的设计和训练协议需要精细的工艺。本文提出一个全面的理论框架来阐明这一重要问题。利用无限过参数化神经网络与高斯过程回归(GPR)之间的等价性,我们推导出一个在大数据集极限下控制PINN预测的积分-微分方程——即神经信息方程。该方程通过反映架构选择的核项对原始方程进行扩展,并允许通过原始微分方程中源项的谱分解来量化网络所引发的隐式偏差。