This paper proposes ShapeShifter, a new 3D generative model that learns to synthesize shape variations based on a single reference model. While generative methods for 3D objects have recently attracted much attention, current techniques often lack geometric details and/or require long training times and large resources. Our approach remedies these issues by combining sparse voxel grids and point, normal, and color sampling within a multiscale neural architecture that can be trained efficiently and in parallel. We show that our resulting variations better capture the fine details of their original input and can handle more general types of surfaces than previous SDF-based methods. Moreover, we offer interactive generation of 3D shape variants, allowing more human control in the design loop if needed.
翻译:本文提出ShapeShifter,一种新型三维生成模型,能够基于单一参考模型学习合成形状变体。尽管三维物体的生成方法近期备受关注,现有技术往往缺乏几何细节和/或需要长时训练与大量计算资源。我们的方法通过在多尺度神经架构中结合稀疏体素网格与点、法向量及颜色采样,实现了高效并行训练,从而解决了上述问题。实验表明,所生成的变体能更精确地捕捉原始输入的细微几何特征,且相比先前基于符号距离函数的方法,能处理更广泛的曲面类型。此外,本方法支持三维形状变体的交互式生成,可在设计流程中按需引入更灵活的人工控制。