Image restoration is a low-level visual task, and most CNN methods are designed as black boxes, lacking transparency and intrinsic aesthetics. Many unsupervised approaches ignore the degradation of visible information in low-light scenes, which will seriously affect the aggregation of complementary information and also make the fusion algorithm unable to produce satisfactory fusion results under extreme conditions. In this paper, we propose Enlighten-anything, which is able to enhance and fuse the semantic intent of SAM segmentation with low-light images to obtain fused images with good visual perception. The generalization ability of unsupervised learning is greatly improved, and experiments on LOL dataset are conducted to show that our method improves 3db in PSNR over baseline and 8 in SSIM. Zero-shot learning of SAM introduces a powerful aid for unsupervised low-light enhancement. The source code of Enlighten Anything can be obtained from https://github.com/zhangbaijin/enlighten-anything
翻译:图像恢复是一项低层视觉任务,大多数CNN方法被设计为黑箱模型,缺乏透明性与内在美感。许多无监督方法忽略了低光照场景中可见信息退化的问题,这将严重影响互补信息的聚合,并导致融合算法在极端条件下无法产生令人满意的融合结果。本文提出Enlighten-anything方法,能够增强并融合SAM分割的语义意图与低光照图像,从而获得具有良好视觉感知的融合图像。该方法大幅提升了无监督学习的泛化能力,在LOL数据集上的实验表明,我们的方法相比基线在PSNR上提升了3dB,在SSIM上提升了8%。SAM的零样本学习为无监督低光照增强引入了强大的辅助手段。Enlighten Anything的源代码可从https://github.com/zhangbaijin/enlighten-anything获取。