Social cues, which convey others' presence, behaviors, or identities, play a crucial role in human information seeking by helping individuals judge relevance and trustworthiness. However, existing LLM-based search systems primarily rely on semantic features, creating a misalignment with the socialized cognition underlying natural information seeking. To address this gap, we explore how the integration of social cues into LLM-based search influences users' perceptions, experiences, and behaviors. Focusing on social media platforms that are beginning to adopt LLM-based search, we integrate design workshops, the implementation of the prototype system (SoulSeek), a between-subjects study, and mixed-method analyses to examine both outcome- and process-level findings. The workshop informs the prototype's cue-integrated design. The study shows that social cues improve perceived outcomes and experiences, promote reflective information behaviors, and reveal limits of current LLM-based search. We propose design implications emphasizing better social-knowledge understanding, personalized cue settings, and controllable interactions.
翻译:社交线索能够传达他人的存在、行为或身份,在人类信息检索中通过帮助个体判断相关性与可信度而发挥着关键作用。然而,现有的基于LLM的检索系统主要依赖语义特征,这与自然信息检索背后的社会化认知存在错位。为弥合这一差距,我们探讨了将社交线索整合到基于LLM的检索中如何影响用户的感知、体验和行为。聚焦于开始采用基于LLM检索的社交媒体平台,我们整合了设计研讨会、原型系统(SoulSeek)的实现、一项被试间研究以及混合方法分析,以检验结果层面和过程层面的发现。研讨会为原型的线索整合设计提供了依据。研究表明,社交线索改善了感知结果与体验,促进了反思性信息行为,并揭示了当前基于LLM检索的局限性。我们提出了强调更好理解社交知识、个性化线索设置以及可控交互的设计启示。