Large Language Models (LLMs) like ChatGPT and GPT-4 have demonstrated impressive proficiency in comprehending and generating natural language. However, they encounter difficulties when tasked with adapting to specialized domains such as accounting. To address this challenge, we introduce Kuaiji, a tailored Accounting Large Language Model. Kuaiji is meticulously fine-tuned using the Baichuan framework, which encompasses continuous pre-training and supervised fine-tuning processes. Supported by CAtAcctQA, a dataset containing large genuine accountant-client dialogues, Kuaiji exhibits exceptional accuracy and response speed. Our contributions encompass the creation of the first Chinese accounting dataset, the establishment of Kuaiji as a leading open-source Chinese accounting LLM, and the validation of its efficacy through real-world accounting scenarios.
翻译:像ChatGPT和GPT-4这样的大语言模型在理解和生成自然语言方面展现了卓越的能力。然而,在面对会计等专业领域的适应任务时,它们遇到了困难。为解决这一挑战,我们引入了Kuaiji,一个定制的会计大语言模型。Kuaiji基于Baichuan框架进行了精心的微调,包括连续预训练和监督微调过程。依托包含大量真实会计师-客户对话的数据集CAtAcctQA,Kuaiji展现出卓越的准确性和响应速度。我们的贡献包括:创建了首个中文会计数据集,将Kuaiji打造为领先的开源中文会计大语言模型,并通过实际会计场景验证了其有效性。