Neural networks have become a widely adopted tool for modeling nonlinear dynamical systems from data. However, the choice of training strategy remains a key design decision, particularly for simulation tasks. This paper compares two predominant strategies: parallel and series-parallel training. The conducted empirical analysis spans five neural network architectures and two examples: a pneumatic valve test bench and an industrial robot benchmark. The study reveals that, even though series-parallel training dominates current practice, parallel training consistently yields better long-term prediction accuracy. Additionally, this work clarifies the often inconsistent terminology in the literature and relate both strategies to concepts from system identification. The findings suggest that parallel training should be considered the default training strategy for neural network-based simulation of dynamical systems.
翻译:神经网络已成为从数据中建模非线性动力学系统的广泛采用工具。然而,训练策略的选择仍然是一个关键的设计决策,特别是在仿真任务中。本文比较了两种主流策略:并行训练与串行-并行训练。实证分析涵盖了五种神经网络架构和两个实例:气动阀门测试台与工业机器人基准。研究表明,尽管串行-并行训练在当前实践中占主导地位,但并行训练始终能获得更好的长期预测精度。此外,本文澄清了文献中常不一致的术语,并将两种策略与系统辨识中的概念联系起来。研究结果表明,在基于神经网络的动力学系统仿真中,应优先考虑将并行训练作为默认训练策略。