Mental health has attracted substantial attention in recent years and LLM can be an effective technology for alleviating this problem owing to its capability in text understanding and dialogue. However, existing research in this domain often suffers from limitations, such as training on datasets lacking crucial prior knowledge and evidence, and the absence of comprehensive evaluation methods. In this paper, we propose a specialized psychological large language model (LLM), named PsycoLLM, trained on a proposed high-quality psychological dataset, including single-turn QA, multi-turn dialogues enriched with prior knowledge and knowledge-based QA. Additionally, to compare the performance of PsycoLLM with other LLMs, we develop a comprehensive psychological benchmark based on authoritative psychological counseling examinations in China, which includes assessments of professional ethics, theoretical proficiency, and case analysis. The experimental results on the benchmark illustrates the effectiveness of PsycoLLM, which demonstrates superior performance compared to other LLMs.

翻译：近年来心理健康问题受到广泛关注，大型语言模型因其在文本理解与对话方面的能力，可成为缓解该问题的有效技术。然而，该领域现有研究常存在局限性，例如训练数据缺乏关键先验知识与证据支撑，以及缺乏综合性评估方法。本文提出一种专业心理大语言模型PsycoLLM，该模型基于我们构建的高质量心理数据集进行训练，该数据集包含单轮问答、融合先验知识的多轮对话及基于知识的问答。此外，为比较PsycoLLM与其他大型语言模型的性能，我们基于中国权威心理咨询考试构建了综合性心理评估基准，涵盖职业道德、理论素养与案例分析能力的测评。基准实验结果表明PsycoLLM具有显著有效性，其性能表现优于其他大型语言模型。