In this paper, we democratise 3D content creation, enabling precise generation of 3D shapes from abstract sketches while overcoming limitations tied to drawing skills. We introduce a novel part-level modelling and alignment framework that facilitates abstraction modelling and cross-modal correspondence. Leveraging the same part-level decoder, our approach seamlessly extends to sketch modelling by establishing correspondence between CLIPasso edgemaps and projected 3D part regions, eliminating the need for a dataset pairing human sketches and 3D shapes. Additionally, our method introduces a seamless in-position editing process as a byproduct of cross-modal part-aligned modelling. Operating in a low-dimensional implicit space, our approach significantly reduces computational demands and processing time.

翻译：本文致力于实现3D内容创作的民主化，通过克服绘画技能的限制，从抽象草图中精确生成三维形状。我们提出了一种新颖的部件级建模与对齐框架，该框架支持抽象建模与跨模态对应。利用相同的部件级解码器，我们的方法通过建立CLIPasso边缘图与投影3D部件区域之间的对应关系，无缝扩展到草图建模，从而消除了配对人工草图与3D形状数据集的必要性。此外，本方法作为跨模态部件对齐建模的副产品，引入了无缝原位编辑过程。在低维隐空间中进行操作，我们的方法显著降低了计算需求和处理时间。