Systems of interacting objects often evolve under the influence of field effects that govern their dynamics, yet previous works have abstracted away from such effects, and assume that systems evolve in a vacuum. In this work, we focus on discovering these fields, and infer them from the observed dynamics alone, without directly observing them. We theorize the presence of latent force fields, and propose neural fields to learn them. Since the observed dynamics constitute the net effect of local object interactions and global field effects, recently popularized equivariant networks are inapplicable, as they fail to capture global information. To address this, we propose to disentangle local object interactions -- which are $\mathrm{SE}(n)$ equivariant and depend on relative states -- from external global field effects -- which depend on absolute states. We model interactions with equivariant graph networks, and combine them with neural fields in a novel graph network that integrates field forces. Our experiments show that we can accurately discover the underlying fields in charged particles settings, traffic scenes, and gravitational n-body problems, and effectively use them to learn the system and forecast future trajectories.
翻译:相互作用物体系统通常在支配其动力学的场效应影响下演化,然而以往研究往往忽略此类效应,假定系统在真空中演化。本工作聚焦于发现这些场,并仅从观测到的动力学过程中推断它们,而非直接观测。我们理论化潜作用力场的存在,并提出用神经场来学习这些场。由于观测到的动力学构成局部物体相互作用与全局场效应的综合结果,近期流行的等变网络在此并不适用,因为它们无法捕捉全局信息。为解决这一问题,我们提出将局部物体相互作用(具有$\mathrm{SE}(n)$等变性且依赖于相对状态)与外部全局场效应(依赖于绝对状态)进行解耦。我们采用等变图网络对相互作用进行建模,并将其与神经场相结合,形成一种集成场力的新型图网络。实验表明,该方法能在带电粒子系统、交通场景及引力N体问题中准确发现潜在场,并有效利用这些场来学习系统动力学及预测未来轨迹。