Aspect Sentiment Understanding (ASU) in interactive scenarios (e.g., Question-Answering and Dialogue) has attracted ever-more interest in recent years and achieved important progresses. However, existing studies on interactive ASU largely ignore the coreference issue for opinion targets (i.e., aspects), while this phenomenon is ubiquitous in interactive scenarios especially dialogues, limiting the ASU performance. Recently, large language models (LLMs) shows the powerful ability to integrate various NLP tasks with the chat paradigm. In this way, this paper proposes a new Chat-based Aspect Sentiment Understanding (ChatASU) task, aiming to explore LLMs' ability in understanding aspect sentiments in dialogue scenarios. Particularly, this ChatASU task introduces a sub-task, i.e., Aspect Chain Reasoning (ACR) task, to address the aspect coreference issue. On this basis, we propose a Trusted Self-reflexion Approach (TSA) with ChatGLM as backbone to ChatASU. Specifically, this TSA treats the ACR task as an auxiliary task to boost the performance of the primary ASU task, and further integrates trusted learning into reflexion mechanisms to alleviate the LLMs-intrinsic factual hallucination problem in TSA. Furthermore, a high-quality ChatASU dataset is annotated to evaluate TSA, and extensive experiments show that our proposed TSA can significantly outperform several state-of-the-art baselines, justifying the effectiveness of TSA to ChatASU and the importance of considering the coreference and hallucination issues in ChatASU.
翻译:交互场景(如问答与对话)中的方面情感理解近年来吸引了越来越多的关注并取得了重要进展。然而,现有交互式方面情感研究在很大程度上忽略了意见目标(即方面)的指代消解问题,而这一现象在交互场景尤其是对话中普遍存在,限制了方面情感理解的性能。近期,大语言模型展现了通过聊天范式整合多种自然语言处理任务的强大能力。基于此,本文提出一项新的基于聊天的方面情感理解任务,旨在探索大语言模型在对话场景中理解方面情感的能力。特别地,该任务引入了一个子任务——方面链推理任务,以解决方面指代消解问题。在此基础上,我们提出了以ChatGLM为骨干的可信自反思方法应用于ChatASU任务。具体而言,该方法将ACR任务作为辅助任务来提升主任务ASU的性能,并进一步将可信学习融入反思机制,以缓解TSA中LLM固有的事实幻觉问题。此外,我们标注了一个高质量的ChatASU数据集来评估TSA,大量实验表明我们提出的TSA显著优于多个最先进基线方法,验证了TSA在ChatASU任务中的有效性,以及考虑指代消解与幻觉问题对ChatASU的重要性。