Scientific Machine Learning (SciML) is concerned with the development of learned emulators of physical systems governed by partial differential equations (PDE). In application domains such as weather forecasting, molecular dynamics, and inverse design, ML-based surrogate models are increasingly used to augment or replace inefficient and often non-differentiable numerical simulation algorithms. While a number of ML-based methods for approximating the solutions of PDEs have been proposed in recent years, they typically do not adapt to the parameters of the PDEs, making it difficult to generalize to PDE parameters not seen during training. We propose a Channel Attention mechanism guided by PDE Parameter Embeddings (CAPE) component for neural surrogate models and a simple yet effective curriculum learning strategy. The CAPE module can be combined with neural PDE solvers allowing them to adapt to unseen PDE parameters. The curriculum learning strategy provides a seamless transition between teacher-forcing and fully auto-regressive training. We compare CAPE in conjunction with the curriculum learning strategy using a popular PDE benchmark and obtain consistent and significant improvements over the baseline models. The experiments also show several advantages of CAPE, such as its increased ability to generalize to unseen PDE parameters without large increases inference time and parameter count.

翻译：科学机器学习（SciML）致力于开发由偏微分方程（PDE）支配的物理系统的学习型仿真器。在天气预报、分子动力学和逆向设计等应用领域，基于机器学习的替代模型正越来越多地被用于增强或替代低效且通常不可微的数值模拟算法。近年来虽已提出多种基于机器学习的方法来近似求解PDE，但它们通常不针对PDE参数进行自适应调整，难以泛化到训练中未见的PDE参数。我们提出了一种基于PDE参数嵌入引导的通道注意力机制（CAPE）组件，用于神经替代模型，并设计了一种简单而有效的课程学习策略。CAPE模块可与神经PDE求解器结合，使其能自适应未见的PDE参数。课程学习策略可在教师强制训练与完全自回归训练之间实现平滑过渡。我们结合课程学习策略，在主流PDE基准测试上对CAPE进行对比评估，结果显示其较基线模型有一致且显著的提升。实验还表明CAPE具有多项优势，例如在不显著增加推理时间和参数量的情况下，能更好地泛化到未见PDE参数。