We propose to use a simulation driven inverse inference approach to model the joint dynamics of tree branches under manipulation. Learning branch dynamics and gaining the ability to manipulate deformable vegetation can help with occlusion-prone tasks, such as fruit picking in dense foliage, as well as moving overhanging vines and branches for navigation in dense vegetation. The underlying deformable tree geometry is encapsulated as coarse spring abstractions executed on parallel, non-differentiable simulators. The implicit statistical model defined by the simulator, reference trajectories obtained by actively probing the ground truth, and the Bayesian formalism, together guide the spring parameter posterior density estimation. Our non-parametric inference algorithm, based on Stein Variational Gradient Descent, incorporates biologically motivated assumptions into the inference process as neural network driven learnt joint priors; moreover, it leverages the finite difference scheme for gradient approximations. Real and simulated experiments confirm that our model can predict deformation trajectories, quantify the estimation uncertainty, and it can perform better when base-lined against other inference algorithms, particularly from the Monte Carlo family. The model displays strong robustness properties in the presence of heteroscedastic sensor noise; furthermore, it can generalise to unseen grasp locations.

翻译：我们提出一种基于仿真的逆推理方法，用于建模操控下树枝的联合动态特性。学习树枝动态并获得操控可变形植被的能力，有助于解决遮挡密集任务，例如在茂密叶丛中进行水果采摘，以及在密集植被中移动悬垂藤蔓和枝条进行导航。底层可变形树形几何结构被封装为在并行的不可微仿真器上执行的粗粒度弹簧抽象。由仿真器定义的隐式统计模型、通过主动探测真实环境获得的参考轨迹以及贝叶斯形式体系共同引导弹簧参数后验密度估计。我们的非参数推理算法基于斯坦因变分梯度下降，将生物学启发的假设作为神经网络驱动的学习联合先验融入推理过程；此外，该算法利用有限差分格式进行梯度近似。真实与仿真实验证实，该模型能预测形变轨迹、量化估计不确定性，并在与其他推理算法（特别是蒙特卡洛系列算法）的对比中表现更优。模型在异方差传感器噪声下展现出强鲁棒性，并能泛化至未见过的抓取位置。