Opportunistic photo capture (e.g., slides, exhibits, or artifacts) is a common strategy for preserving information encountered in information-rich environments for later revisitation. While fast and minimally disruptive, such photo collections rarely become meaningful notes. Existing automatic note-generation approaches provide some support but often produce generic summaries that fail to reflect what users intended to capture. We introduce Intent Lenses, a conceptual primitive for intent-mediated note generation and sensemaking. Intent Lenses reify users' capture-time intent inferred from captured information into reusable interactive objects that encode the function to perform, the information sources to focus on, and how results are represented at an appropriate level of detail. These lenses are dynamically generated using the reasoning capabilities of large language models. To investigate this concept, we instantiate Intent Lenses in the context of academic conference photos and present an interactive system that infers lenses from presentation captures to generate structured visual notes on a spatial canvas. Users can further add, link, and arrange lenses across captures to support exploration and sensemaking. A study with nine academics showed that intent-mediated notes aligned with users' expectations, providing effective overviews of their captures while facilitating deeper sensemaking.
翻译:机会性拍照(如拍摄幻灯片、展品或实物)是在信息丰富环境中保存信息以供后续回顾的常见策略。尽管这种方法快速且干扰最小,但这类照片集合很少能成为有意义的笔记。现有的自动笔记生成方法提供了一定支持,但往往生成通用的摘要,无法反映用户原本的拍摄意图。我们提出“意图透镜”这一概念原型,用于实现意图介导的笔记生成与意义建构。意图透镜将用户从拍摄信息中推断出的拍摄意图具体化为可复用的交互对象,这些对象编码了待执行的功能、应关注的信息源以及如何以适当细节层级呈现结果。这些透镜通过大语言模型的推理能力动态生成。为探索这一概念,我们在学术会议照片的场景中实例化了意图透镜,并构建了一个交互系统,该系统从演示内容拍摄中推断意图透镜,在空间画布上生成结构化视觉笔记。用户可进一步添加、链接和排列不同拍摄内容对应的透镜,以支持探索与意义建构。与九位学术研究者的用户研究表明,意图介导的笔记符合用户预期,既能有效呈现拍摄内容概览,又能促进更深层的意义建构。