Recent advances in the development of large language models are rapidly changing how online applications function. LLM-based search tools, for instance, offer a natural language interface that can accommodate complex queries and provide detailed, direct responses. At the same time, there have been concerns about the veracity of the information provided by LLM-based tools due to potential mistakes or fabrications that can arise in algorithmically generated text. In a set of online experiments we investigate how LLM-based search changes people's behavior relative to traditional search, and what can be done to mitigate overreliance on LLM-based output. Participants in our experiments were asked to solve a series of decision tasks that involved researching and comparing different products, and were randomly assigned to do so with either an LLM-based search tool or a traditional search engine. In our first experiment, we find that participants using the LLM-based tool were able to complete their tasks more quickly, using fewer but more complex queries than those who used traditional search. Moreover, these participants reported a more satisfying experience with the LLM-based search tool. When the information presented by the LLM was reliable, participants using the tool made decisions with a comparable level of accuracy to those using traditional search, however we observed overreliance on incorrect information when the LLM erred. Our second experiment further investigated this issue by randomly assigning some users to see a simple color-coded highlighting scheme to alert them to potentially incorrect or misleading information in the LLM responses. Overall we find that this confidence-based highlighting substantially increases the rate at which users spot incorrect information, improving the accuracy of their overall decisions while leaving most other measures unaffected.

翻译：大型语言模型的最新进展正迅速改变在线应用的功能。例如，基于LLM的搜索工具提供了一种自然语言接口，能够处理复杂查询并生成详细、直接的响应。同时，由于算法生成的文本可能出现错误或虚构信息，人们对基于LLM工具所提供信息的准确性存在担忧。在一系列在线实验中，我们研究了基于LLM的搜索如何相对于传统搜索改变人们的行为，以及如何减轻对LLM输出的过度依赖。实验参与者被要求完成一系列涉及研究和比较不同产品的决策任务，并被随机分配使用基于LLM的搜索工具或传统搜索引擎。在第一个实验中，我们发现使用基于LLM工具的参与者能够更快地完成任务，使用的查询次数更少但复杂度更高。此外，这些参与者报告了对基于LLM搜索工具的更高满意度。当LLM呈现的信息可靠时，使用该工具的参与者的决策准确性与使用传统搜索的参与者相当，但我们在LLM出错时观察到对错误信息的过度依赖。第二个实验进一步研究了这一问题，通过随机分配部分用户查看一种简单的颜色编码高亮方案，以提醒他们注意LLM响应中潜在的错误或误导信息。总体而言，我们发现这种基于置信度的高亮方案显著提高了用户发现错误信息的比率，改善了整体决策的准确性，同时不影响其他大多数指标。