Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production.

翻译：业余制作微电影和短视频的创作者通常需要花费大量时间和精力，经历多轮繁琐的场景、情节和摄像机设置与调整过程，才能获得令人满意的视频镜头。我们提出虚拟动态故事板系统，允许用户在虚拟环境中进行镜头故事板设计，使拍摄人员在实际拍摄前能轻松测试镜头设置。该系统采用“提议-模拟-判别”运行模式：以格式化故事脚本和摄像机脚本为输入，依据预定义的故事和电影规则生成多个人物动画和摄像机运动方案，供现有仿真引擎渲染视频。为了从候选方案中挑选出最高质量的动态故事板，我们为其配备了基于专业人工创建数据学习的镜头质量判别器。通过大量实验和用户研究对虚拟动态故事板进行了全面验证，证明了其在辅助业余视频制作中的高效性、有效性及巨大潜力。