This technical report presents our Restormer-Plus approach, which was submitted to the GT-RAIN Challenge (CVPR 2023 UG$^2$+ Track 3). Details regarding the challenge are available at http://cvpr2023.ug2challenge.org/track3.html. Our Restormer-Plus outperformed all other submitted solutions in terms of peak signal-to-noise ratio (PSNR). It consists mainly of four modules: the single image de-raining module, the median filtering module, the weighted averaging module, and the post-processing module. We named the single-image de-raining module Restormer-X, which is built on Restormer and performed on each rainy image. The median filtering module is employed as a median operator for the 300 rainy images associated with each scene. The weighted averaging module combines the median filtering results with that of Restormer-X to alleviate overfitting if we only use Restormer-X. Finally, the post-processing module is used to improve the brightness restoration. Together, these modules render Restormer-Plus to be one state-of-the-art solution to the GT-RAIN Challenge. Our code is available at https://github.com/ZJLAB-AMMI/Restormer-Plus.
翻译:本技术报告介绍了我们提交至GT-RAIN挑战赛(CVPR 2023 UG$^2$+ Track 3)的Restormer-Plus方法。挑战赛详情可访问http://cvpr2023.ug2challenge.org/track3.html。Restormer-Plus在峰值信噪比(PSNR)指标上超越所有其他参赛方案,主要由四个模块构成:单幅图像去雨模块、中值滤波模块、加权平均模块和后处理模块。其中单幅图像去雨模块命名为Restormer-X,基于Restormer架构构建,处理每一幅雨图像;中值滤波模块对每场景300幅雨图像执行中值滤波操作;加权平均模块将中值滤波结果与Restormer-X输出进行融合,以缓解仅使用Restormer-X时的过拟合问题;后处理模块用于提升亮度恢复效果。各模块协同作用,使Restormer-Plus成为GT-RAIN挑战赛的最优解。我们的代码已开源:https://github.com/ZJLAB-AMMI/Restormer-Plus。