Generative AI tools such as chatGPT are poised to change the way people engage with online information. Recently, Microsoft announced their "new Bing" search system which incorporates chat and generative AI technology from OpenAI. Google has announced plans to deploy search interfaces that incorporate similar types of technology. These new technologies will transform how people can search for information. The research presented here is an early investigation into how people make use of a generative AI chat system (referred to simply as chat from here on) as part of a search process, and how the incorporation of chat systems with existing search tools may effect users search behaviors and strategies. We report on an exploratory user study with 10 participants who used a combined Chat+Search system that utilized the OpenAI GPT-3.5 API and the Bing Web Search v5 API. Participants completed three search tasks. In this pre-print paper of preliminary results, we report on ways that users integrated AI chat into their search process, things they liked and disliked about the chat system, their trust in the chat responses, and their mental models of how the chat system generated responses.
翻译:生成式人工智能工具(如ChatGPT)正深刻改变人们与在线信息交互的方式。近期,微软宣布其“新必应”搜索系统整合了OpenAI的聊天与生成式AI技术,谷歌也计划部署融合类似技术的搜索界面。这些新技术将重塑信息检索的途径。本研究作为一项早期探索,旨在揭示人们在搜索过程中如何使用生成式AI聊天系统(以下简称为“聊天系统”),以及将聊天系统与现有搜索工具结合如何影响用户的搜索行为与策略。我们报告了一项包含10名参与者的探索性用户研究,参与者使用结合了OpenAI GPT-3.5 API与必应网页搜索v5 API的“聊天+搜索”系统完成三项搜索任务。在这篇初步结果的预印本论文中,我们分析了用户将AI聊天融入搜索过程的方式、对聊天系统的偏好与不满意度、对聊天回复的信任程度,以及用户对聊天系统生成回复机制的认知模型。