While the design of blind image quality assessment (IQA) algorithms has improved significantly, the distribution shift between the training and testing scenarios often leads to a poor performance of these methods at inference time. This motivates the study of test time adaptation (TTA) techniques to improve their performance at inference time. Existing auxiliary tasks and loss functions used for TTA may not be relevant for quality-aware adaptation of the pre-trained model. In this work, we introduce two novel quality-relevant auxiliary tasks at the batch and sample levels to enable TTA for blind IQA. In particular, we introduce a group contrastive loss at the batch level and a relative rank loss at the sample level to make the model quality aware and adapt to the target data. Our experiments reveal that even using a small batch of images from the test distribution helps achieve significant improvement in performance by updating the batch normalization statistics of the source model.
翻译:尽管盲图像质量评估(IQA)算法的设计已取得显著进展,但训练与测试场景之间的分布偏移往往导致这些方法在推理时性能欠佳。这推动了测试时自适应(TTA)技术的研究,以提升其在推理阶段的性能。现有用于TTA的辅助任务和损失函数可能不适用于预训练模型的质感知自适应。本文在批次级和样本级引入了两种新颖的质感知相关辅助任务,以实现面向盲IQA的TTA。具体而言,我们在批次级引入组对比损失,在样本级引入相对排序损失,使模型具备质量感知能力并适应目标数据。实验表明,即使仅使用来自测试分布的小批量图像,通过更新源模型的批归一化统计量,也能显著提升性能。