Defining and measuring trust in dynamic, multiagent teams is important in a range of contexts, particularly in defense and security domains. Team members should be trusted to work towards agreed goals and in accordance with shared values. In this paper, our concern is with the definition of goals and values such that it is possible to define 'trust' in a way that is interpretable, and hence usable, by both humans and robots. We argue that the outcome of team activity can be considered in terms of 'goal', 'individual/team values', and 'legal principles'. We question whether alignment is possible at the level of 'individual/team values', or only at the 'goal' and 'legal principles' levels. We argue for a set of metrics to define trust in human-robot teams that are interpretable by human or robot team members, and consider an experiment that could demonstrate the notion of 'satisficing trust' over the course of a simulated mission.
翻译:在动态多智能体团队中定义和衡量信任在多种情境下至关重要,尤其是在国防和安全领域。团队成员应被信任以共同致力于达成共识的目标,并遵循共同的价值观。本文关注目标和价值观的定义,使得能够以人类和机器人均可解释(从而可用)的方式定义“信任”。我们认为,团队活动的结果可以从“目标”、“个体/团队价值观”和“法律原则”三个层面来考量。我们质疑是否能在“个体/团队价值观”层面实现对齐,抑或仅能在“目标”和“法律原则”层面实现。我们提出一套指标,用以定义人机团队中可由人类或机器人团队成员解释的信任,并考虑通过一项实验来演示在模拟任务过程中“满足型信任”的概念。