Mixed Reality (MR) aims to blend digital and physical worlds, but the absence of haptic feedback often breaks visual-tactile consistency. We introduce Prop-Chromeleon, a MR system based on generative artificial intelligence (AI) that dynamically transforms everyday objects into adaptive passive haptic props through user-provided text prompts. Our AI pipeline performs generation and anchoring of virtual assets that align with the shape of physical props, allowing us to study how virtual content generation behaves under geometric and prompt-based constraints. We evaluate Prop-Chromeleon's effectiveness through a generation study using varied object shapes and user prompts, combining quantitative shape similarity metrics with qualitative prompt fidelity analysis. Our user study further showcases Prop-Chromeleon's improvements in perceived realism, immersion, and enjoyment compared to static baselines. These results show that shape-aware generation can support both believable haptic interaction and creative engagement in MR.

翻译：摘要：混合现实（MR）旨在融合数字世界与物理世界，但触觉反馈的缺失常破坏视觉-触觉一致性。我们提出Prop-Chromeleon——一种基于生成式人工智能（AI）的混合现实系统，通过用户提供的文本提示，将日常物体动态转化为自适应被动触觉道具。我们的AI流水线能够生成并与物理道具形状对齐的虚拟资产，从而研究虚拟内容生成在几何约束和提示约束下的表现。通过结合定量形状相似度指标与定性提示保真度分析，我们使用多样物体形状和用户提示进行生成研究，评估Prop-Chromeleon的有效性。用户研究进一步表明，与静态基线相比，Prop-Chromeleon在感知真实性、沉浸感和愉悦感方面均有提升。这些结果表明，形状感知生成既能支持可信的触觉交互，也能促进混合现实中的创造性参与。