Coordinated multi-arm manipulation requires satisfying multiple simultaneous geometric constraints across high-dimensional configuration spaces, which poses a significant challenge for traditional planning and control methods. In this work, we propose Adaptive Diffusion Constrained Sampling (ADCS), a generative framework that flexibly integrates both equality (e.g., relative and absolute pose constraints) and structured inequality constraints (e.g., proximity to object surfaces) into an energy-based diffusion model. Equality constraints are modeled using dedicated energy networks trained on pose differences in Lie algebra space, while inequality constraints are represented via Signed Distance Functions (SDFs) and encoded into learned constraint embeddings, allowing the model to reason about complex spatial regions. A key innovation of our method is a Transformer-based architecture that learns to weight constraint-specific energy functions at inference time, enabling flexible and context-aware constraint integration. Moreover, we adopt a two-phase sampling strategy that improves precision and sample diversity by combining Langevin dynamics with resampling and density-aware re-weighting. Experimental results on dual-arm manipulation tasks show that ADCS significantly improves sample diversity and generalization across settings demanding precise coordination and adaptive constraint handling.
翻译:协调的多臂操作需要在高维构型空间中同时满足多个几何约束,这对传统的规划与控制方法提出了重大挑战。本文提出自适应扩散约束采样(ADCS),一种生成式框架,能够灵活地将等式约束(如相对与绝对位姿约束)和结构化不等式约束(如接近物体表面)集成到基于能量的扩散模型中。等式约束通过专门在李代数空间中对位姿差异进行训练的能量网络建模,而不等式约束则通过符号距离函数(SDF)表示并编码到学习到的约束嵌入中,使模型能够推理复杂的空间区域。本方法的一个关键创新是采用基于Transformer的架构,该架构在推理时学习对特定约束的能量函数进行加权,从而实现灵活且上下文感知的约束集成。此外,我们采用两阶段采样策略,通过将朗之万动力学与重采样及密度感知重加权相结合,提高了采样精度与多样性。在双臂操作任务上的实验结果表明,ADCS在需要精确协调和自适应约束处理的各种场景中,显著提升了样本多样性和泛化能力。