We present a technique for controlling physically simulated characters using user inputs from an off-the-shelf depth camera. Our controller takes a real-time stream of user poses as input, and simulates a stream of target poses of a biped based on it. The simulated biped mimics the user's actions while moving forward at a modest speed and maintaining balance. The controller is parameterized over a set of modulated reference motions that aims to cover the range of possible user actions. For real-time simulation, the best set of control parameters for the current input pose is chosen from the parameterized sets of pre-computed control parameters via a regression method. By applying the chosen parameters at each moment, the simulated biped can imitate a range of user actions while walking in various interactive scenarios.

翻译：我们提出了一种使用市售深度相机的用户输入来控制物理模拟角色的技术。控制器将用户姿态的实时流作为输入，并据此模拟出双足角色的目标姿态流。模拟的双足角色在模仿用户动作的同时，能以适中的速度向前移动并保持平衡。控制器通过一组调制的参考运动进行参数化，旨在覆盖用户可能动作的范围。在实时模拟中，通过回归方法从预计算控制参数的参数化集合中，为当前输入姿态选择最佳控制参数集。通过每时刻应用所选参数，模拟的双足角色能够模仿用户的各种动作，并能在多种交互场景中行走。