Navigating certain communication situations can be challenging due to individuals' lack of skills and the interference of strong emotions. However, effective learning opportunities are rarely accessible. In this work, we conduct a human-centered study that uses language models to simulate bespoke communication training and provide just-in-time feedback to support the practice and learning of interpersonal effectiveness skills. We apply the interpersonal effectiveness framework from Dialectical Behavioral Therapy (DBT), DEAR MAN, which focuses on both conversational and emotional skills. We present IMBUE, an interactive training system that provides feedback 25% more similar to experts' feedback, compared to that generated by GPT-4. IMBUE is the first to focus on communication skills and emotion management simultaneously, incorporate experts' domain knowledge in providing feedback, and be grounded in psychology theory. Through a randomized trial of 86 participants, we find that IMBUE's simulation-only variant significantly improves participants' self-efficacy (up to 17%) and reduces negative emotions (up to 25%). With IMBUE's additional just-in-time feedback, participants demonstrate 17% improvement in skill mastery, along with greater enhancements in self-efficacy (27% more) and reduction of negative emotions (16% more) compared to simulation-only. The improvement in skill mastery is the only measure that is transferred to new and more difficult situations; situation specific training is necessary for improving self-efficacy and emotion reduction.
翻译:摘要:由于个体缺乏沟通技巧及强烈情绪的干扰,某些沟通情境可能极具挑战性,然而有效的学习机会却十分匮乏。本研究开展了一项以人为中心的研究,利用语言模型模拟定制化沟通训练,并提供即时反馈以支持人际效能技巧的练习与学习。我们应用了辩证行为疗法(DBT)中的人际效能框架——DEAR MAN,该框架同时关注对话技巧与情绪管理能力。我们提出了交互式训练系统IMBUE,其提供的反馈与GPT-4生成的反馈相比,与专家反馈的相似度提升了25%。IMBUE是首个同时聚焦沟通技巧与情绪管理、整合专家领域知识提供反馈,并基于心理学理论构建的系统。通过一项包含86名参与者的随机试验,我们发现:仅使用模拟训练的IMBUE变体能显著提升参与者的自我效能感(最高提升17%),并降低负面情绪(最高降低25%)。与仅采用模拟训练相比,附加即时反馈的IMBUE系统使参与者的技能掌握程度提升17%,自我效能感进一步提升27%,负面情绪减少幅度增加16%。值得注意的是,技能掌握程度的提升是唯一可迁移至新且更具挑战性情境的指标;而自我效能感的提升与负面情绪的减少仍需针对特定情境的训练。