This work aims to improve texture inpainting after clutter removal in scanned indoor meshes. This is achieved with a new UV mapping pre-processing step which leverages semantic information of indoor scenes to more accurately match the UV islands with the 3D representation of distinct structural elements like walls and floors. Semantic UV Mapping enriches classic UV unwrapping algorithms by not only relying on geometric features but also visual features originating from the present texture. The segmentation improves the UV mapping and simultaneously simplifies the 3D geometric reconstruction of the scene after the removal of loose objects. Each segmented element can be reconstructed separately using the boundary conditions of the adjacent elements. Because this is performed as a pre-processing step, other specialized methods for geometric and texture reconstruction can be used in the future to improve the results even further.
翻译:本研究旨在改进扫描室内网格中杂物移除后的纹理修复效果。通过引入新的UV映射预处理步骤,利用室内场景的语义信息更精确地将UV岛与墙壁、地板等独立结构元素的三维表示进行匹配。语义UV映射不仅依赖几何特征,同时利用现有纹理产生的视觉特征,从而丰富了经典UV展开算法。该分割方法既优化了UV映射,又简化了移除松散物体后的场景三维几何重建过程。每个分割元素均可利用相邻元素的边界条件进行独立重建。由于该步骤作为预处理环节实施,未来可结合其他专业的几何与纹理重建方法以进一步提升结果质量。