Existing unified methods typically treat multi-degradation image restoration as a multi-task learning problem. Despite performing effectively compared to single degradation restoration methods, they overlook the utilization of commonalities and specificities within multi-task restoration, thereby impeding the model's performance. Inspired by the success of deep generative models and fine-tuning techniques, we proposed a universal image restoration framework based on multiple low-rank adapters (LoRA) from multi-domain transfer learning. Our framework leverages the pre-trained generative model as the shared component for multi-degradation restoration and transfers it to specific degradation image restoration tasks using low-rank adaptation. Additionally, we introduce a LoRA composing strategy based on the degradation similarity, which adaptively combines trained LoRAs and enables our model to be applicable for mixed degradation restoration. Extensive experiments on multiple and mixed degradations demonstrate that the proposed universal image restoration method not only achieves higher fidelity and perceptual image quality but also has better generalization ability than other unified image restoration models. Our code is available at https://github.com/Justones/UIR-LoRA.
翻译:现有的统一方法通常将多退化图像恢复视为一个多任务学习问题。尽管与单一退化恢复方法相比表现有效,但它们忽略了多任务恢复中共性与特性的利用,从而阻碍了模型的性能。受深度生成模型和微调技术成功的启发,我们提出了一种基于多领域迁移学习中多重低秩适配器(LoRA)的通用图像恢复框架。我们的框架利用预训练的生成模型作为多退化恢复的共享组件,并通过低秩自适应将其迁移到特定退化图像恢复任务中。此外,我们引入了一种基于退化相似性的LoRA组合策略,该策略自适应地组合已训练的LoRA,使我们的模型能够适用于混合退化恢复。在多种及混合退化上的大量实验表明,所提出的通用图像恢复方法不仅实现了更高的保真度和感知图像质量,而且比其他统一图像恢复模型具有更好的泛化能力。我们的代码可在 https://github.com/Justones/UIR-LoRA 获取。