Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual Dynamic Storyboard (VDS) to allow users storyboarding shots in virtual environments, where the filming staff can easily test the settings of shots before the actual filming. VDS runs on a "propose-simulate-discriminate" mode: Given a formatted story script and a camera script as input, it generates several character animation and camera movement proposals following predefined story and cinematic rules to allow an off-the-shelf simulation engine to render videos. To pick up the top-quality dynamic storyboard from the candidates, we equip it with a shot ranking discriminator based on shot quality criteria learned from professional manual-created data. VDS is comprehensively validated via extensive experiments and user studies, demonstrating its efficiency, effectiveness, and great potential in assisting amateur video production.

翻译：业余制作微电影和短视频的用户通常需要花费大量时间和精力，经历多轮复杂的场景、情节和摄像机设置调整过程，才能获得满意的视频镜头。我们提出了虚拟动态分镜（VDS），使用户能够在虚拟环境中完成镜头分镜设计，使拍摄人员在实际拍摄前轻松测试镜头设置。VDS采用"提出-模拟-判别"模式运行：以格式化故事脚本和摄像机脚本为输入，生成多个遵循预定义故事和电影规则的角色动画与摄像机运动方案，从而支持现成仿真引擎渲染视频。为从候选方案中筛选出最优动态分镜，我们基于专业人工数据学习镜头质量准则，为其配备镜头排序判别器。通过大量实验和用户研究，VDS的有效性和高效性得到全面验证，展现出辅助业余视频制作的巨大潜力。