Salient Object Detection (SOD) aims to identify and segment the most conspicuous objects in an image or video. As an important pre-processing step, it has many potential applications in multimedia and vision tasks. With the advance of imaging devices, SOD with high-resolution images is of great demand, recently. However, traditional SOD methods are largely limited to low-resolution images, making them difficult to adapt to the development of High-Resolution SOD (HRSOD). Although some HRSOD methods emerge, there are no large enough datasets for training and evaluating. Besides, current HRSOD methods generally produce incomplete object regions and irregular object boundaries. To address above issues, in this work, we first propose a new HRS10K dataset, which contains 10,500 high-quality annotated images at 2K-8K resolution. As far as we know, it is the largest dataset for the HRSOD task, which will significantly help future works in training and evaluating models. Furthermore, to improve the HRSOD performance, we propose a novel Recurrent Multi-scale Transformer (RMFormer), which recurrently utilizes shared Transformers and multi-scale refinement architectures. Thus, high-resolution saliency maps can be generated with the guidance of lower-resolution predictions. Extensive experiments on both high-resolution and low-resolution benchmarks show the effectiveness and superiority of the proposed framework. The source code and dataset are released at: https://github.com/DrowsyMon/RMFormer.
翻译:显著目标检测(SOD)旨在识别并分割图像或视频中最引人注目的目标。作为重要的预处理步骤,它在多媒体与视觉任务中具有诸多潜在应用。随着成像设备的发展,近年来对高分辨率图像的SOD需求日益增长。然而传统SOD方法主要局限于低分辨率图像,难以适应高分辨率显著目标检测(HRSOD)的发展需求。尽管已有部分HRSOD方法出现,但缺乏足够规模的数据集用于训练与评估。此外,现有HRSOD方法通常产生不完整的目标区域和不规则的目标边界。针对上述问题,本文首先提出一个新的HRS10K数据集,包含10,500张2K-8K分辨率的高质量标注图像。据我们所知,这是当前规模最大的HRSOD专用数据集,将极大促进未来模型训练与评估工作。同时,为提升HRSOD性能,我们提出新颖的递归多尺度Transformer(RMFormer),通过递归共享Transformer与多尺度优化架构,借助低分辨率预测生成高分辨率显著图。在高低分辨率基准上的大量实验表明,所提框架具有显著有效性和优越性。源代码与数据集已开源至:https://github.com/DrowsyMon/RMFormer。