While burst LR images are useful for improving the SR image quality compared with a single LR image, prior SR networks accepting the burst LR images are trained in a deterministic manner, which is known to produce a blurry SR image. In addition, it is difficult to perfectly align the burst LR images, making the SR image more blurry. Since such blurry images are perceptually degraded, we aim to reconstruct the sharp high-fidelity boundaries. Such high-fidelity images can be reconstructed by diffusion models. However, prior SR methods using the diffusion model are not properly optimized for the burst SR task. Specifically, the reverse process starting from a random sample is not optimized for image enhancement and restoration methods, including burst SR. In our proposed method, on the other hand, burst LR features are used to reconstruct the initial burst SR image that is fed into an intermediate step in the diffusion model. This reverse process from the intermediate step 1) skips diffusion steps for reconstructing the global structure of the image and 2) focuses on steps for refining detailed textures. Our experimental results demonstrate that our method can improve the scores of the perceptual quality metrics. Code: https://github.com/placerkyo/BSRD
翻译:尽管与单张低分辨率图像相比,突发低分辨率图像有助于提升超分辨率图像质量,但现有接受突发低分辨率图像的超分辨率网络以确定性方式训练,这会导致生成模糊的超分辨率图像。此外,突发低分辨率图像难以完美对齐,进一步加剧了超分辨率图像的模糊性。由于此类模糊图像在感知上存在退化,我们旨在重建清晰的高保真边界。扩散模型能够重建此类高保真图像,然而现有基于扩散模型的超分辨率方法并未针对突发超分辨率任务进行优化——尤其从随机样本起始的逆过程不适用于包括突发超分辨率在内的图像增强与复原方法。与之相对,本文提出的方法利用突发低分辨率特征重构初始突发超分辨率图像,并将其输入扩散模型的中间步骤。这种从中间步骤开始的逆过程能够:1)跳过重建图像全局结构的扩散步骤;2)聚焦于细化细节纹理的步骤。实验结果表明,该方法能显著提升感知质量指标的评分。代码:https://github.com/placerkyo/BSRD