We present MemoryDiorama, a prototype system that introduces augmented memory cues, a concept that extends captured personal media with AI-generated contextual information to enhance autobiographical memory recall. MemoryDiorama transforms everyday photos into dynamic 3D dioramas in mixed reality by integrating LLM-based scene analysis with 3D object generation, animation, and spatial composition. The system extracts geographic information, object attributes, lighting conditions, and atmospheric elements from the photos. It then animates these elements with generative components such as object animations, human motion, geographical effects, and particle effects to provide richer cues for memory recall. We evaluated MemoryDiorama in a within-subject user study with 18 participants, comparing three conditions: Photo-Only, Static Diorama, and MemoryDiorama. Compared with both Photo-Only and Static Diorama, MemoryDiorama elicited more internal and in-cue details during recall. It also increased perceptual details and visual vividness ratings, suggesting richer recollective experience.
翻译:我们提出了MemoryDiorama,一个原型系统,该系统引入了增强记忆线索的概念——通过AI生成的上下文信息扩展个人拍摄的媒体内容,以增强自传体记忆回忆。MemoryDiorama结合基于大语言模型的场景分析与3D物体生成、动画及空间构图技术,将日常照片转化为混合现实中的动态3D立体模型。系统从照片中提取地理信息、物体属性、光照条件及大气元素,并通过生成式组件(如物体动画、人体运动、地理效果及粒子效果)为这些元素赋予动态表现,从而为记忆回忆提供更丰富的线索。我们开展了一项包含18名参与者的被试内用户研究,在三种条件(仅照片、静态立体模型、MemoryDiorama)下对MemoryDiorama进行了评估。与仅照片和静态立体模型相比,MemoryDiorama在回忆过程中能激发更多内部细节和线索细节,同时提升了感知细节与视觉生动性评分,表明其带来了更丰富的回忆体验。