Bokeh rendering is one of the most popular techniques in photography. It can make photographs visually appealing, forcing users to focus their attentions on particular area of image. However, achieving satisfactory bokeh effect usually presents significant challenge, since mobile cameras with restricted optical systems are constrained, while expensive high-end DSLR lens with large aperture should be needed. Therefore, many deep learning-based computational photography methods have been developed to mimic the bokeh effect in recent years. Nevertheless, most of these methods were limited to rendering bokeh effect in certain single aperture. There lacks user-friendly bokeh rendering method that can provide precise focal plane control and customised bokeh generation. There as well lacks authentic realistic bokeh dataset that can potentially promote bokeh learning on variable apertures. To address these two issues, in this paper, we have proposed an effective controllable bokeh rendering method, and contributed a Variable Aperture Bokeh Dataset (VABD). In the proposed method, user can customize focal plane to accurately locate concerned subjects and select target aperture information for bokeh rendering. Experimental results on public EBB! benchmark dataset and our constructed dataset VABD have demonstrated that the customized focal plane together aperture prompt can bootstrap model to simulate realistic bokeh effect. The proposed method has achieved competitive state-of-the-art performance with only 4.4M parameters, which is much lighter than mainstream computational bokeh models. The contributed dataset and source codes will be released on github https://github.com/MoTong-AI-studio/VABM.
翻译:散景渲染是摄影中最受欢迎的技术之一。它能使照片在视觉上更具吸引力,引导观者聚焦于图像的特定区域。然而,获得令人满意的散景效果通常面临重大挑战,因为受限于光学系统的移动摄像头能力有限,而实现该效果往往需要配备大光圈的高端单反镜头。因此,近年来已开发出许多基于深度学习的计算摄影方法来模拟散景效果。尽管如此,大多数现有方法仅限于渲染特定单一光圈下的散景效果。目前尚缺乏能够提供精确焦平面控制和定制化散景生成的用户友好型散景渲染方法,同时也缺乏能够有效促进可变光圈散景学习的真实感散景数据集。为解决这两个问题,本文提出了一种有效的可控散景渲染方法,并贡献了一个可变光圈散景数据集(VABD)。在所提方法中,用户可自定义焦平面以精确定位关注主体,并选择目标光圈信息进行散景渲染。在公开的EBB!基准数据集及我们构建的VABD数据集上的实验结果表明,定制化焦平面结合光圈提示能够引导模型模拟出逼真的散景效果。所提方法仅用440万参数即达到了具有竞争力的最先进性能,比主流计算散景模型更为轻量化。贡献的数据集与源代码将在github平台发布:https://github.com/MoTong-AI-studio/VABM。