The boundary representation (B-Rep) models a 3D solid as its explicit boundaries: trimmed corners, edges, and faces. Recovering B-Rep representation from unstructured data is a challenging and valuable task of computer vision and graphics. Recent advances in deep learning have greatly improved the recovery of 3D shape geometry, but still depend on dense and clean point clouds and struggle to generalize to novel shapes. We propose B-Rep Gaussian Splatting (BrepGaussian), a novel framework that learns 3D parametric representations from 2D images. We employ a Gaussian Splatting renderer with learnable features, followed by a specific fitting strategy. To disentangle geometry reconstruction and feature learning, we introduce a two-stage learning framework that first captures geometry and edges and then refines patch features to achieve clean geometry and coherent instance representations. Extensive experiments demonstrate the superior performance of our approach to state-of-the-art methods.
翻译:边界表示(B-Rep)将三维实体建模为其显式边界:裁剪后的角、边和面。从非结构化数据中恢复B-Rep表示是计算机视觉与图形学领域一项具有挑战性且价值重大的任务。深度学习的最新进展极大提升了三维形状几何的恢复能力,但仍依赖密集且清洁的点云数据,且难以泛化至新型形状。我们提出B-Rep高斯泼溅(BrepGaussian)这一创新框架,可从二维图像中学习三维参数化表示。该方法采用具备可学习特征的高斯泼溅渲染器,并辅以特定的拟合策略。为解耦几何重建与特征学习,我们引入两阶段学习框架:首先捕捉几何与边缘信息,随后优化面片特征,以实现清洁的几何结构与连贯的实例表示。大量实验表明,本方法相较于现有最优方法具有显著优越性。