We present Pelican-Unify 1.0, the first embodied foundation model trained according to the principle of unification. Pelican-Unify 1.0 uses a single VLM as a unified understanding module, mapping scenes, instructions, visual contexts, and action histories into a shared semantic space. The same VLM also serves as a unified reasoning module, autoregressively producing task-, action-, and future-oriented chains of thought in a single forward pass and projecting the final hidden state into a dense latent variable. A Unified Future Generator (UFG) then conditions on this latent variable and jointly generates future videos and future actions through two modality-specific output heads within the same denoising process. The language, video, and action losses are all backpropagated into the shared representation, enabling the model to jointly optimize understanding, reasoning, imagination, and action during training, rather than training three isolated expert systems. Experiments demonstrate that unification does not imply compromise. With a single checkpoint, Pelican-Unify 1.0 achieves strong performance across all three capabilities: 64.7 on eight VLM benchmarks, the best among comparable-scale models; 66.03 on WorldArena, ranking first; and 93.5 on RoboTwin, the second-best average among compared action methods. These results show that the unified paradigm succeeds in preserving specialist strength while bringing understanding, reasoning, imagination, and action into one model.
翻译:我们提出Pelican-Unify 1.0,这是首个遵循统一原则训练的具身基础模型。Pelican-Unify 1.0采用单一VLM作为统一理解模块,将场景、指令、视觉上下文和动作历史映射到共享语义空间。同一VLM也作为统一推理模块,在单次前向传递中自回归生成面向任务、动作和未来的思维链,并将最终隐藏状态投影为稠密潜变量。随后,统一未来生成器(UFG)以该潜变量为条件,在相同的去噪过程中通过两个模态专用输出头联合生成未来视频和未来动作。语言、视频和动作损失均反向传播至共享表征,使模型能够在训练时联合优化理解、推理、想象和行动,而非训练三个孤立的专家系统。实验表明,统一并不意味着妥协。通过单一检查点,Pelican-Unify 1.0在三种能力上均展现出强劲性能:在八项VLM基准测试中得分64.7,为可比规模模型中的最优;在WorldArena上得分66.03,排名第一;在RoboTwin上得分93.5,在比较的动作方法中平均分排名第二。这些结果表明,统一范式在保持专家优势的同时,成功将理解、推理、想象和行动整合至单一模型中。