This paper presents ChatCounselor, a large language model (LLM) solution designed to provide mental health support. Unlike generic chatbots, ChatCounselor is distinguished by its foundation in real conversations between consulting clients and professional psychologists, enabling it to possess specialized knowledge and counseling skills in the field of psychology. The training dataset, Psych8k, was constructed from 260 in-depth interviews, each spanning an hour. To assess the quality of counseling responses, the counseling Bench was devised. Leveraging GPT-4 and meticulously crafted prompts based on seven metrics of psychological counseling assessment, the model underwent evaluation using a set of real-world counseling questions. Impressively, ChatCounselor surpasses existing open-source models in the counseling Bench and approaches the performance level of ChatGPT, showcasing the remarkable enhancement in model capability attained through high-quality domain-specific data.
翻译:本文介绍了ChatCounselor,一种专为提供心理健康支持而设计的大型语言模型(LLM)解决方案。与通用聊天机器人不同,ChatCounselor基于咨询客户与专业心理咨询师之间的真实对话构建,使其具备心理学领域的专业知识和咨询技能。训练数据集Psych8k源自260次深度访谈(每次时长一小时)。为评估咨询回复质量,我们设计了咨询基准(Counseling Bench)。结合GPT-4及基于心理咨询七维度评估指标精心设计的提示词,该模型通过一系列真实咨询问题进行了评估。令人瞩目的是,ChatCounselor在咨询基准上超越现有开源模型,且性能接近ChatGPT,充分展示了高质量领域特定数据对模型能力的显著提升效果。