Data visualizations and narratives are often integrated to convey data stories effectively. Among various data storytelling formats, data videos have been garnering increasing attention. These videos provide an intuitive interpretation of data charts while vividly articulating the underlying data insights. However, the production of data videos demands a diverse set of professional skills and considerable manual labor, including understanding narratives, linking visual elements with narration segments, designing and crafting animations, recording audio narrations, and synchronizing audio with visual animations. To simplify this process, our paper introduces a novel method, referred to as Data Player, capable of automatically generating dynamic data videos with narration-animation interplay. This approach lowers the technical barriers associated with creating data videos rich in narration. To enable narration-animation interplay, Data Player constructs references between visualizations and text input. Specifically, it first extracts data into tables from the visualizations. Subsequently, it utilizes large language models to form semantic connections between text and visuals. Finally, Data Player encodes animation design knowledge as computational low-level constraints, allowing for the recommendation of suitable animation presets that align with the audio narration produced by text-to-speech technologies. We assessed Data Player's efficacy through an example gallery, a user study, and expert interviews. The evaluation results demonstrated that Data Player can generate high-quality data videos that are comparable to human-composed ones.

翻译：数据可视化与叙事通常被整合以有效传达数据故事。在各种数据叙事形式中，数据视频正受到越来越多的关注。这类视频不仅直观解读数据图表，还能生动阐述潜在的数据洞见。然而，制作数据视频需要多种专业技能和大量人工劳动，包括理解叙事、将视觉元素与叙事片段关联、设计和制作动画、录制音频旁白以及同步音频与视觉动画。为简化这一流程，本文提出了一种名为Data Player的新方法，能够自动生成具备叙事-动画交织的动态数据视频。该方法降低了创作富含旁白的数据视频的技术门槛。为实现叙事与动画的交互，Data Player构建了可视化与文本输入之间的参照关系。具体而言，它首先从可视化中提取数据表格，随后利用大语言模型在文本与视觉之间建立语义连接。最后，Data Player将动画设计知识编码为计算级底层约束，从而推荐与文本转语音技术生成的音频旁白相匹配的合适动画预设。我们通过示例画廊、用户研究和专家访谈评估了Data Player的效果。评估结果表明，Data Player能生成与人工制作相媲美的高质量数据视频。