Vision-Language-Action (VLA) models are emerging as a promising paradigm for robotic manipulation, enabling general-purpose policies trained from large corpora of demonstrations and action labels. However, adapting these models to new tasks still typically requires task-specific demonstrations, action annotations, and additional fine-tuning, making deployment costly and difficult to scale. We propose WIZARD, a weight-space meta-learning framework that sidesteps task-specific fine-tuning by generating task-specific LoRA parameters for a frozen VLA policy. Given only a language instruction and a short demonstration video, WIZARD predicts the corresponding adaptation weights in a single forward pass, without target-task action labels or test-time optimization. During meta-training, WIZARD learns to map task evidence directly to expert LoRA updates, capturing relationships between tasks in weight space. Experiments on LIBERO show that WIZARD improves performance by up to ~2x on unseen dataset collections and up to ~14x on unseen tasks. On a Franka Emika Panda, WIZARD consistently improves over a real-domain adapted baseline, showing that generated adapters provide task-level specialization beyond simulation.
翻译:视觉-语言-动作(VLA)模型正成为一种有前景的机器人操作范式,能够通过大规模演示和动作标签语料库训练通用策略。然而,将这些模型适配到新任务通常仍需任务特定的演示、动作标注和额外微调,导致部署成本高昂且难以扩展。我们提出WIZARD——一种权重空间元学习框架,通过为冻结的VLA策略生成任务特定的LoRA参数,绕过任务特定的微调过程。仅需一条语言指令和一段简短的演示视频,WIZARD即可在单次前向传播中预测对应的自适应权重,无需目标任务的动作标签或测试时优化。在元训练阶段,WIZARD学习将任务证据直接映射为专家级LoRA更新,在权重空间中捕捉任务间的关联关系。在LIBERO上的实验表明,WIZARD在未见数据集上的性能提升高达约2倍,在未见任务上的性能提升高达约14倍。在Franka Emika Panda机器人上的实验显示,WIZARD持续优于经过真实场景域适配的基线方法,证明其生成的适配器能在仿真之外提供任务级别的专业化能力。