3D modeling of biological structures is an inherently complex process, necessitating both biological and geometric understanding. Additionally, the complexity of user interfaces of 3D modeling tools and the associated steep learning curve further exacerbate the difficulty of authoring a 3D model. In this paper, we introduce a novel framework to address the challenge of using 3D modeling software by converting users' textual inputs into modeling actions within an interactive procedural modeling system. The framework incorporates a code generator of a novel code format and a corresponding code interpreter. The major technical innovation includes the user-refinement mechanism that captures the degree of user dissatisfaction with the modeling outcome, offers an interactive revision, and leverages this feedback for future improved 3D modeling. This entire framework is powered by large language models and eliminates the need for a traditional training process. We develop a prototype tool named Chat Modeling, offering both automatic and step-by-step 3D modeling approaches. Our evaluation of the framework with structural biologists highlights the potential of our approach being utilized in their scientific workflows. All supplemental materials are available at https://osf.io/x4qb7/.

翻译：生物结构的三维建模本质上是一个复杂过程，需要同时具备生物学与几何学理解能力。此外，三维建模工具用户界面的复杂性与陡峭的学习曲线，进一步加剧了创建三维模型的难度。本文提出一种新型框架，通过将用户的文本输入转化为交互式程序化建模系统中的建模操作，以解决三维建模软件的使用难题。该框架包含采用新型代码格式的代码生成器及对应的代码解释器。主要技术创新在于用户优化机制：该机制可捕捉用户对建模结果的不满程度，提供交互式修正，并将此反馈用于改进后续三维建模过程。整个框架由大型语言模型驱动，无需传统训练流程。我们开发了名为Chat Modeling的原型工具，提供自动与逐步两种三维建模方法。通过与结构生物学家的框架评估，验证了该方法在其科研工作流程中的应用潜力。所有补充材料见https://osf.io/x4qb7/。