3D object reconstruction, and camera pose estimation in industrial applications are challenging tasks, as errors are costly while the computation time is often limited. The complexity of typical industrial objects further complicates these tasks. Most of the existing datasets in this context do not depict realistic industrial scenarios. Therefore, we introduce the Machine Vision Metrology Industrial Object Dataset (MVM-IOD). Images of typical industrial objects are captured systematically, by moving a camera, mounted at the end effector of an industrial robot arm, on a hemisphere around the objects. MVM-IOD contains reference camera poses and reference 3D point clouds, the acquired RGB images of 9 objects and 2 background choices resulting in 18 scenes, which allows evaluation of all image based methods that compute a 3D reconstruction, camera poses, or novel views of a scene. Based on MVM-IOD, we extensively evaluate current SOTA 3D reconstruction and camera pose estimation methods, such as Structure from Motion, Multi-View Stereo, recent feed forward methods (Visual Geometry Grounded Transformer, π3), and 2D Gaussian Splatting and report our findings as a baseline for future research. The experiments show that capture setups like ours generate out-of distribution images for feed forward methods, leading to suboptimal point clouds and camera poses. However, these out-of-distribution images can be shifted closer to the training distribution by applying simple preprocessing steps. Consequently, in certain industrial applications, feed forward methods should be used with caution.
翻译:三维物体重建及工业应用中的相机位姿估计是极具挑战性的任务,因为误差代价高昂且计算时间通常受限。典型工业物体的复杂性进一步增加了这些任务的难度。现有的大多数相关数据集未能描绘真实的工业场景。为此,我们提出机器视觉计量工业物体数据集(MVM-IOD)。该数据集通过将安装在工业机器人臂末端执行器上的相机沿半球轨迹系统移动,对典型工业物体进行拍摄。MVM-IOD包含参考相机位姿、参考三维点云、9个物体的RGB图像及2种背景选择(共18个场景),可评估所有基于图像的三维重建、相机位姿估计或场景新视角合成方法。基于MVM-IOD,我们全面评估了当前最先进的三维重建与相机位姿估计方法,包括运动恢复结构、多视图立体、近期前馈方法(视觉几何基Transformer、π3)及二维高斯泼溅,并报告结果作为未来研究的基准。实验表明:类似本研究的采集装置会生成前馈方法的分布外图像,导致点云与相机位姿质量欠佳;但通过简单预处理步骤可将这些分布外图像向训练分布偏移。因此,在特定工业应用中需谨慎使用前馈方法。