Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production.

翻译：业余人员制作微电影和短视频时，通常需要花费大量时间和精力，反复进行场景、情节和摄像机的设置与调整，以拍摄出令人满意的镜头。我们提出了虚拟动态故事板（VDS），使用户能够在虚拟环境中进行镜头故事板设计，从而在正式拍摄前轻松测试镜头设置。VDS基于“提案-模拟-判别”模式运行：给定格式化的故事脚本和摄像机脚本作为输入，系统会生成多个角色动画和摄像机运动提案，这些提案遵循预设的故事和电影规则，以便现成的模拟引擎渲染视频。为从候选方案中选出最高质量的动态故事板，我们配备了一个基于镜头质量准则的镜头排序判别器，该准则从专业人工创建的数据中学习。通过大量实验和用户研究，我们对VDS进行了全面验证，证明了其在辅助业余视频制作中的高效性、有效性及巨大潜力。