Gestures that accompany speech are an essential part of natural and efficient embodied human communication. The automatic generation of such co-speech gestures is a long-standing problem in computer animation and is considered an enabling technology in film, games, virtual social spaces, and for interaction with social robots. The problem is made challenging by the idiosyncratic and non-periodic nature of human co-speech gesture motion, and by the great diversity of communicative functions that gestures encompass. Gesture generation has seen surging interest recently, owing to the emergence of more and larger datasets of human gesture motion, combined with strides in deep-learning-based generative models, that benefit from the growing availability of data. This review article summarizes co-speech gesture generation research, with a particular focus on deep generative models. First, we articulate the theory describing human gesticulation and how it complements speech. Next, we briefly discuss rule-based and classical statistical gesture synthesis, before delving into deep learning approaches. We employ the choice of input modalities as an organizing principle, examining systems that generate gestures from audio, text, and non-linguistic input. We also chronicle the evolution of the related training data sets in terms of size, diversity, motion quality, and collection method. Finally, we identify key research challenges in gesture generation, including data availability and quality; producing human-like motion; grounding the gesture in the co-occurring speech in interaction with other speakers, and in the environment; performing gesture evaluation; and integration of gesture synthesis into applications. We highlight recent approaches to tackling the various key challenges, as well as the limitations of these approaches, and point toward areas of future development.

翻译：伴随言语的手势是自然高效具身人类交流的重要组成部分。自动生成此类共语手势是计算机动画领域的长期难题，被视为电影、游戏、虚拟社交空间及社交机器人交互中的使能技术。人类共语手势动作的特异性与非周期性特征，以及手势所涵盖的交际功能多样性，使得该问题极具挑战性。近年来，随着人类手势动作数据集规模与数量的增长，结合基于深度学习的生成模型在数据可用性提升下的突破，手势生成研究呈现井喷式发展。本综述聚焦共语手势生成研究，特别关注深度生成模型。首先，我们阐述描述人类手势行为的理论及其如何补充言语信息。其次，在深入探讨深度学习方法前，简要讨论基于规则及经典统计的手势合成技术。我们以输入模态选择为组织框架，系统梳理从音频、文本及非语言输入生成手势的系统。同时，从规模、多样性、动作质量及采集方法维度，追溯相关训练数据集的演进历程。最后，我们识别手势生成领域的关键研究挑战，包括：数据可用性与质量、类人动作生成、会话交互中手势与共现言语的语境化、环境感知、手势评估方法以及手势合成在应用中的集成。针对各关键挑战，我们重点评述最新应对方案及其局限性，并指明未来发展方向。