Neural Style Transfer (NST) research has been applied to images, videos, 3D meshes and radiance fields, but its application to 3D computer games remains relatively unexplored. Whilst image and video NST systems can be used as a post-processing effect for a computer game, this results in undesired artefacts and diminished post-processing effects. Here, we present an approach for injecting depth-aware NST as part of the 3D rendering pipeline. Qualitative and quantitative experiments are used to validate our in-game stylisation framework. We demonstrate temporally consistent results of artistically stylised game scenes, outperforming state-of-the-art image and video NST methods.
翻译:神经风格迁移(NST)研究已应用于图像、视频、三维网格和辐射场,但其在三维计算机游戏中的应用仍相对鲜有探索。尽管图像和视频NST系统可作为计算机游戏的后处理特效使用,但这会导致伪影并削弱后处理效果。在此,我们提出一种将深度感知NST注入三维渲染管线的方法。通过定性与定量实验验证我们的游戏内风格化框架,我们展示了在艺术化风格化游戏场景中具有时间一致性的结果,其性能优于当前最先进的图像与视频NST方法。