This paper studies the 3D instance segmentation problem, which has a variety of real-world applications such as robotics and augmented reality. Since the surroundings of 3D objects are of high complexity, the separating of different objects is very difficult. To address this challenging problem, we propose a novel framework to group and refine the 3D instances. In practice, we first learn an offset vector for each point and shift it to its predicted instance center. To better group these points, we propose a Hierarchical Point Grouping algorithm to merge the centrally aggregated points progressively. All points are grouped into small clusters, which further gradually undergo another clustering procedure to merge into larger groups. These multi-scale groups are exploited for instance prediction, which is beneficial for predicting instances with different scales. In addition, a novel MaskScoreNet is developed to produce binary point masks of these groups for further refining the segmentation results. Extensive experiments conducted on the ScanNetV2 and S3DIS benchmarks demonstrate the effectiveness of the proposed method. For instance, our approach achieves a 66.4\% mAP with the 0.5 IoU threshold on the ScanNetV2 test set, which is 1.9\% higher than the state-of-the-art method.

翻译：本文研究3D 例分解问题, 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 例分解问题 3D 实例分解问题 3D 对象的周围环境 3D 分解问题 3D 分解问题 3D 实例分解问题 3D 实例分解问题 3D 实例分解问题 3D 。 3D 例分解问题 3D 对象的周围环境非常复杂 复杂, 3D 和 扩大 3DIS 基准 。 由于 3D 3D 对象组分解问题 3D 分解问题 3D 问题 3D 3D 例分解问题 3D 3D 3D 3D 例分解分解问题 3D 3D 例分解问题 3D 3D 共分解问题 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 例分解解解解解解解 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 例 例 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3 3 3 3D 3D 3D 3 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3 3 3D 3D 3 3D 3D 3 3 3 3 3D 3D 3D 3D 3 3 3D 3 3 3D 3 3 3 3 3 3