The increasing integration of AI-powered tools into expert workflows, such as medicine, law, and finance, raises a critical question: how does AI involvement influence a user's trust in the human expert, the AI system, and their combination? To investigate this, we conducted a user study (N=77) featuring a simulated course-planning task. We compared various conditions that differed in both the presence of AI and the specific mode of human-AI collaboration. Our results indicate that while the advisor's ability to create a correct schedule is important, the user's perception of expertise and trust is also influenced by how the expert utilized the AI assistant. These findings raise important considerations for the design of human-AI hybrid teams, particularly when the adoption of recommendations depends on the end-user's perception of the recommender's expertise.
翻译:随着人工智能工具在医学、法律和金融等专业工作流程中的日益整合,一个关键问题随之产生:人工智能的参与如何影响用户对人类专家、人工智能系统及其组合的信任?为探究此问题,我们开展了一项用户研究(N=77),模拟课程规划任务。我们比较了不同条件下人工智能的存在性以及人机协作的具体模式。研究结果表明,虽然顾问制定正确课程表的能力至关重要,但用户对专业能力的感知和信任也受到专家如何利用人工智能助手的影响。这些发现为人机混合团队的设计提出了重要考量,特别是在建议采纳取决于最终用户对推荐者专业能力感知的情况下。