Physical simulations produce excellent predictions of weather effects. Neural radiance fields produce SOTA scene models. We describe a novel NeRF-editing procedure that can fuse physical simulations with NeRF models of scenes, producing realistic movies of physical phenomena in those scenes. Our application -- Climate NeRF -- allows people to visualize what climate change outcomes will do to them. ClimateNeRF allows us to render realistic weather effects, including smog, snow, and flood. Results can be controlled with physically meaningful variables like water level. Qualitative and quantitative studies show that our simulated results are significantly more realistic than those from SOTA 2D image editing and SOTA 3D NeRF stylization.
翻译:物理模拟能够出色地预测天气效应。神经辐射场提供了最先进的场景模型。我们提出了一种新颖的NeRF编辑流程,可将物理模拟与场景的NeRF模型相融合,从而生成这些场景中物理现象的逼真影片。我们的应用——ClimateNeRF——使人们能够直观地了解气候变化带来的后果。ClimateNeRF可以渲染出逼真的天气效应,包括雾霾、降雪和洪水。结果可通过水位等具有物理意义的变量进行控制。定性和定量研究表明,我们模拟的结果明显优于来自最先进2D图像编辑和最先进3D NeRF风格化方法的效果。