As human-agent teaming (HAT) research continues to grow, computational methods for modeling HAT behaviors and measuring HAT effectiveness also continue to develop. One rising method involves the use of human digital twins (HDT) to approximate human behaviors and socio-emotional-cognitive reactions to AI-driven agent team members. In this paper, we address three research questions relating to the use of digital twins for modeling trust in HATs. First, to address the question of how we can appropriately model and operationalize HAT trust through HDT HAT experiments, we conducted causal analytics of team communication data to understand the impact of empathy, socio-cognitive, and emotional constructs on trust formation. Additionally, we reflect on the current state of the HAT trust science to discuss characteristics of HAT trust that must be replicable by a HDT such as individual differences in trust tendencies, emergent trust patterns, and appropriate measurement of these characteristics over time. Second, to address the question of how valid measures of HDT trust are for approximating human trust in HATs, we discuss the properties of HDT trust: self-report measures, interaction-based measures, and compliance type behavioral measures. Additionally, we share results of preliminary simulations comparing different LLM models for generating HDT communications and analyze their ability to replicate human-like trust dynamics. Third, to address how HAT experimental manipulations will extend to human digital twin studies, we share experimental design focusing on propensity to trust for HDTs vs. transparency and competency-based trust for AI agents.
翻译:随着人机协作团队研究领域的持续扩展,用于建模团队行为及评估协作效能的计算方法也在不断发展。其中,新兴的研究手段是利用人类数字孪生来模拟人类行为及其对AI智能体团队成员的社会-情感-认知反应。本文围绕数字孪生在建模人机协作团队信任中的运用,探讨了三个核心研究问题。首先,针对如何通过数字孪生实验恰当建模并量化团队信任的问题,我们通过对团队沟通数据进行因果分析,揭示了共情能力、社会认知及情感建构对信任形成的影响机制。同时,基于当前人机协作信任科学的研究现状,我们探讨了数字孪生必须复现的团队信任特征,包括个体信任倾向差异、涌现性信任模式以及这些特征随时间演化的有效测量方法。其次,为评估数字孪生信任度量对人类信任的近似效度,我们系统分析了数字孪生信任的三类测量属性:自我报告测量、交互行为测量及依从型行为测量。此外,我们分享了比较不同大语言模型生成数字孪生沟通数据的初步仿真结果,并评估了这些模型复现类人信任动态的能力。最后,针对人机协作实验范式向数字孪生研究的延伸问题,我们提出了聚焦于数字孪生信任倾向与AI智能体透明度及能力信任对比的实验设计方案。