Immersion plays a vital role when designing cinematic creations, yet the difficulty in immersive shooting prevents designers to create satisfactory outputs. In this work, we analyze the specific components that contribute to cinematographic immersion considering spatial, emotional, and aesthetic level, while these components are then combined into a high-level evaluation mechanism. Guided by such a immersion mechanism, we propose a GAN-based camera control system that is able to generate actor-driven camera movements in the 3D virtual environment to obtain immersive film sequences. The proposed encoder-decoder architecture in the generation flow transfers character motion into camera trajectory conditioned on an emotion factor. This ensures spatial and emotional immersion by performing actor-camera synchronization physically and psychologically. The emotional immersion is further strengthened by incorporating regularization that controls camera shakiness for expressing different mental statuses. To achieve aesthetic immersion, we make effort to improve aesthetic frame compositions by modifying the synthesized camera trajectory. Based on a self-supervised adjustor, the adjusted camera placements can project the character to the appropriate on-frame locations following aesthetic rules. The experimental results indicate that our proposed camera control system can efficiently offer immersive cinematic videos, both quantitatively and qualitatively, based on a fine-grained immersive shooting. Live examples are shown in the supplementary video.

翻译：沉浸感在电影创作设计中至关重要，但沉浸式拍摄的难度阻碍了创作者获得满意的成果。本研究分析了构成电影沉浸感的具体要素，涵盖空间、情感与美学三个维度，并将这些要素整合为高层级评估机制。在该沉浸机制的引导下，我们提出基于生成对抗网络的摄像机控制系统，能够在三维虚拟环境中生成由演员驱动的摄像机运动序列，从而获得沉浸式电影片段。生成流程中采用的编码器-解码器架构将角色动作转化为融合情感因子的摄像机轨迹，通过物理与心理层面的演员-摄像机同步确保空间与情感沉浸感。通过引入控制摄像机抖动程度的正则化方法表达不同心理状态，进一步强化情感沉浸。在美学沉浸层面，我们通过改进合成摄像机轨迹提升画面构图质量：基于自监督调整器，经调整的摄像机位置可按照美学规则将角色投影到最佳画面位置。实验结果表明，所提摄像机控制系统能基于精细化的沉浸式拍摄，在定量与定性层面高效提供沉浸式电影视频。补充视频展示了实时示例。