Nowadays, most 3D model quality assessment (3DQA) methods have been aimed at improving performance. However, little attention has been paid to the computational cost and inference time required for practical applications. Model-based 3DQA methods extract features directly from the 3D models, which are characterized by their high degree of complexity. As a result, many researchers are inclined towards utilizing projection-based 3DQA methods. Nevertheless, previous projection-based 3DQA methods directly extract features from multi-projections to ensure quality prediction accuracy, which calls for more resource consumption and inevitably leads to inefficiency. Thus in this paper, we address this challenge by proposing a no-reference (NR) projection-based \textit{\underline{G}rid \underline{M}ini-patch \underline{S}ampling \underline{3D} Model \underline{Q}uality \underline{A}ssessment (GMS-3DQA)} method. The projection images are rendered from six perpendicular viewpoints of the 3D model to cover sufficient quality information. To reduce redundancy and inference resources, we propose a multi-projection grid mini-patch sampling strategy (MP-GMS), which samples grid mini-patches from the multi-projections and forms the sampled grid mini-patches into one quality mini-patch map (QMM). The Swin-Transformer tiny backbone is then used to extract quality-aware features from the QMMs. The experimental results show that the proposed GMS-3DQA outperforms existing state-of-the-art NR-3DQA methods on the point cloud quality assessment databases. The efficiency analysis reveals that the proposed GMS-3DQA requires far less computational resources and inference time than other 3DQA competitors. The code will be available at https://github.com/zzc-1998/GMS-3DQA.
翻译:当前,大多数三维模型质量评估方法致力于提升性能,但针对实际应用场景中计算开销与推理时间的研究尚显不足。基于模型的3DQA方法直接从三维模型中提取特征,具有高度复杂性的特点,因此众多研究者更倾向于采用基于投影的3DQA方法。然而,传统投影方法通过多视角投影图像直接提取特征以确保质量预测精度,这导致资源消耗显著增加且不可避免地引发效率低下问题。为此,本文提出一种无参考的投影型网格迷你块采样三维模型质量评估方法。该方法从三维模型的六个正交视角渲染投影图像以覆盖充足的质量信息。为减少冗余并降低推理资源消耗,我们提出多投影网格迷你块采样策略:从多视角投影中采样网格迷你块,并将其整合为单张质量迷你块图。随后采用轻量级Swin-Transformer骨干网络从质量迷你块图中提取质量感知特征。实验结果表明,在点云质量评估数据库上,所提方法优于现有最优无参考三维模型质量评估方法。效率分析显示,与其他三维模型质量评估方法相比,本方法所需的计算资源与推理时间显著更少。代码将开源至https://github.com/zzc-1998/GMS-3DQA。