We introduce a novel method for real-time animation control and generation on rigged models using natural language input. First, we embed a large language model (LLM) in Unity to output structured texts that can be parsed into diverse and realistic animations. Second, we illustrate LLM's potential to enable flexible state transition between existing animations. We showcase the robustness of our approach through qualitative results on various rigged models and motions.
翻译:我们提出了一种新颖的方法,通过自然语言输入实现绑定模型的实时动画控制与生成。首先,我们将大型语言模型(LLM)嵌入至Unity引擎,使其输出结构化文本,从而解析为多样化且逼真的动画。其次,我们展示了LLM在现有动画间实现灵活状态转换的潜力。通过在不同绑定模型与动作上的定性结果,我们验证了该方法具备鲁棒性。