It is challenging but highly desired to acquire high-quality photos with clear content in low-light environments. Although multi-image processing methods (using burst, dual-exposure, or multi-exposure images) have made significant progress in addressing this issue, they typically focus exclusively on specific restoration or enhancement tasks, being insufficient in exploiting multi-image. Motivated by that multi-exposure images are complementary in denoising, deblurring, high dynamic range imaging, and super-resolution, we propose to utilize bracketing photography to unify restoration and enhancement tasks in this work. Due to the difficulty in collecting real-world pairs, we suggest a solution that first pre-trains the model with synthetic paired data and then adapts it to real-world unlabeled images. In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed. Moreover, we construct a data simulation pipeline to synthesize pairs and collect real-world images from 200 nighttime scenarios. Experiments on both datasets show that our method performs favorably against the state-of-the-art multi-image processing ones. The dataset, code, and pre-trained models are available at https://github.com/cszhilu1998/BracketIRE.
翻译:在低光环境下获取内容清晰的高质量照片既具挑战性又备受期待。尽管多图像处理方法(利用连拍、双曝光或多曝光图像)在解决此问题上取得了显著进展,但通常仅专注于特定复原或增强任务,未能充分利用多图像优势。基于多曝光图像在去噪、去模糊、高动态范围成像及超分辨率方面具有互补性,本研究提出利用括号摄影技术统一图像复原与增强任务。针对真实世界成对数据难以收集的问题,我们提出先使用合成配对数据预训练模型,再将其适配至真实无标注图像的解决方案。特别地,本文提出了时序调制循环网络(TMRNet)与自监督适配方法。此外,我们构建了数据模拟管线以合成配对数据,并从200个夜间场景中采集真实图像。在两个数据集上的实验表明,本方法性能优于最先进的多图像处理方法。数据集、代码与预训练模型已开源至 https://github.com/cszhilu1998/BracketIRE。