LLM-driven conversational AI is beginning to disappear into the background, shifting from something used directly towards something increasingly integrated into existing workflows. In the process, markers of origin and training are smoothed away as LLMs become commodified in the eyes of users. We explore how people approach using a web browser with conversational AI built in, focusing on how they develop their understanding and determine whether to trust its outputs. We conducted a study where 20 participants used the Copilot AI features in Microsoft Edge to conduct information retrieval and planning tasks. Participants relied on a combination of existing perceptions of LLMs and internet search, tracing the effect of beliefs about how Copilot generated answers on prompting strategies. The inclusion of citations increased the trustworthiness of answers without participants feeling the need to be check them, with participants often reaching for the same information sources as the CAI when fact-checking.

翻译：由大语言模型驱动的对话式AI正逐渐融入日常，从直接使用的工具转向嵌入现有工作流程的组件。在此过程中，随着LLM在用户眼中被商品化，其训练背景与起源标识逐渐淡去。我们探索了用户如何接触内置对话AI的网页浏览器，重点关注其理解构建过程及决定是否信任其输出的依据。我们开展了一项研究：20名参与者使用Microsoft Edge中的Copilot AI功能进行信息检索与规划任务。参与者结合了既有的LLM与互联网搜索认知，追踪了关于Copilot生成答案方式的信念对其提示策略的影响。引用标注增加了答案的可信度，但参与者并未感到需要核查引用内容——事实上，参与者在事实核查时往往倾向于查阅与对话式AI相同的信息源。