We present VR-Doh, a hands-on 3D modeling system designed for creating and manipulating elastoplastic objects in virtual reality (VR). The system employs the Material Point Method (MPM) for simulating realistic large deformations and incorporates optimized Gaussian Splatting for seamless rendering. With direct, hand-based interactions, users can naturally sculpt, deform, and edit objects interactively. To achieve real-time performance, we developed localized simulation techniques, optimized collision handling, and separated appearance and physical representations, ensuring smooth and responsive user interaction. The system supports both freeform creation and precise adjustments, catering to diverse modeling tasks. A user study involving novice and experienced users highlights the system's intuitive design, immersive feedback, and creative potential. Compared to traditional geometry-based modeling tools, our approach offers improved accessibility and natural interaction in specific contexts.
翻译:我们提出了VR-Doh,一个专为在虚拟现实(VR)中创建和操作弹塑性物体而设计的沉浸式三维建模系统。该系统采用物质点法(MPM)模拟真实的大变形,并融合了优化的高斯溅射技术以实现无缝渲染。通过直接的、基于手部的交互方式,用户可以自然地以交互方式进行雕刻、变形和编辑物体。为实现实时性能,我们开发了局部化模拟技术、优化了碰撞处理,并分离了外观与物理表示,从而确保了流畅且响应迅速的用户交互。该系统同时支持自由创作与精确调整,适用于多样化的建模任务。一项涵盖新手与经验用户的用户研究凸显了该系统直观的设计、沉浸式的反馈以及创造性潜力。与传统的基于几何的建模工具相比,我们的方法在特定情境下提供了更高的可访问性和更自然的交互体验。