The aim of this workshop is to bring together experts working on open-domain dialogue research. In this speedily advancing research area many challenges still exist, such as learning information from conversations, engaging in realistic and convincing simulation of human intelligence and reasoning. SCI-CHAT follows previous workshops on open domain dialogue but with a focus on the simulation of intelligent conversation as judged in a live human evaluation. Models aim to include the ability to follow a challenging topic over a multi-turn conversation, while positing, refuting and reasoning over arguments. The workshop included both a research track and shared task. The main goal of this paper is to provide an overview of the shared task and a link to an additional paper that will include an in depth analysis of the shared task results following presentation at the workshop.
翻译:本次研讨会的宗旨是汇聚开放域对话研究领域的专家学者。在此快速发展的研究领域中仍存在诸多挑战,例如从对话中学习信息、实现具有真实性和说服力的人类智能与推理模拟等。SCI-CHAT沿袭了此前开放域对话研讨会的传统,但聚焦于通过实时人工评估判定的智能对话模拟。模型需具备在多轮对话中追踪复杂话题的能力,同时能够对论点进行提出、反驳及推理。本次研讨会包含研究议程与共享任务两大板块。本文的核心目标是概述共享任务内容,并附上将于研讨会报告后发表的深度分析论文链接,该论文将详细剖析共享任务的评测结果。