Creating data videos that effectively narrate stories with animated visuals requires substantial effort and expertise. A promising research trend is leveraging the easy-to-use natural language (NL) interaction to automatically synthesize data video components from narrative content like text narrations, or NL commands that specify user-required designs. Nevertheless, previous research has overlooked the integration of narrative content and specific design authoring commands, leading to generated results that lack customization or fail to seamlessly fit into the narrative context. To address these issues, we introduce a novel paradigm for creating data videos, which seamlessly integrates users' authoring and narrative intents in a unified format called annotated narration, allowing users to incorporate NL commands for design authoring as inline annotations within the narration text. Informed by a formative study on users' preference for annotated narration, we develop a prototype system named Data Playwright that embodies this paradigm for effective creation of data videos. Within Data Playwright, users can write annotated narration based on uploaded visualizations. The system's interpreter automatically understands users' inputs and synthesizes data videos with narration-animation interplay, powered by large language models. Finally, users can preview and fine-tune the video. A user study demonstrated that participants can effectively create data videos with Data Playwright by effortlessly articulating their desired outcomes through annotated narration.
翻译:创作能够通过动态视觉有效叙述故事的数据视频需要大量努力与专业知识。一个前景广阔的研究趋势是利用易于使用的自然语言交互,从文本叙述等叙事内容或指定用户所需设计的自然语言命令中自动合成数据视频组件。然而,先前研究忽视了叙事内容与具体设计创作命令的整合,导致生成结果缺乏定制性或无法无缝融入叙事语境。为解决这些问题,我们提出了一种新颖的数据视频创作范式,该范式将用户的创作意图与叙事意图无缝整合于一种称为"标注叙事"的统一格式中,允许用户在叙述文本中以内联标注的形式融入用于设计创作的自然语言命令。基于一项关于用户对标注叙事偏好的形成性研究,我们开发了一个名为Data Playwright的原型系统,该系统体现了这一范式,用于高效创作数据视频。在Data Playwright中,用户可根据上传的可视化图表撰写标注叙事。系统的解释器能自动理解用户输入,并借助大语言模型合成具有叙述-动画交互效果的数据视频。最后,用户可预览并微调视频。一项用户研究表明,参与者能够通过Data Playwright,轻松运用标注叙事表达其预期效果,从而高效创建数据视频。