Exploring moral dilemmas allows individuals to navigate moral complexity, where a reversal in decision certainty, shifting toward the opposite of one's initial choice, could reflect open-mindedness and less rigidity. This study probes how nonverbal emotional cues from conversational agents could influence decision certainty in moral dilemmas. While existing research heavily focused on verbal aspects of human-agent interaction, we investigated the impact of agents expressing anger and sadness towards the moral situations through animated chat balloons. We compared these with a baseline where agents offered same responses without nonverbal cues. Results show that agents displaying anger significantly caused reversal shifts in decision certainty. The interaction between participant gender and agents' nonverbal emotional cues significantly affects participants' perception of AI's influence. These findings reveal that even subtly altering agents' nonverbal cues may impact human moral decisions, presenting both opportunities to leverage these effects for positive outcomes and ethical risks for future human-AI systems.
翻译:探索道德困境有助于个体应对道德复杂性,其中决策确定性的反转(即转向与初始选择相反的立场)可反映开放心态与较低的思维固化。本研究探讨对话智能体所呈现的非言语情感线索如何影响道德困境中的决策确定性。现有研究主要关注人机交互的言语层面,而本文通过动态聊天气泡考察智能体对道德情境表达愤怒与悲伤情绪的影响,并与智能体提供相同回应但无非言语线索的基线条件进行对比。结果显示,呈现愤怒情绪的智能体显著引发决策确定性的反转转变。参与者性别与智能体非言语情感线索的交互作用显著影响其对AI影响力的感知。这些发现表明,即使细微调整智能体的非言语线索也可能影响人类的道德决策,这既为利用此类效应达成积极结果提供了可能,也为未来人机协作系统带来了伦理风险。