Large language models (LLMs) have become powerful tools for advancing natural language processing applications in the financial industry. However, existing financial LLMs often face challenges such as hallucinations or superficial parameter training, resulting in suboptimal performance, particularly in financial computing and machine reading comprehension (MRC). To address these issues, we propose a novel large language model specifically designed for the Chinese financial domain, named SNFinLLM. SNFinLLM excels in domain-specific tasks such as answering questions, summarizing financial research reports, analyzing sentiment, and executing financial calculations. We then perform the supervised fine-tuning (SFT) to enhance the model's proficiency across various financial domains. Specifically, we gather extensive financial data and create a high-quality instruction dataset composed of news articles, professional papers, and research reports of finance domain. Utilizing both domain-specific and general datasets, we proceed with continuous pre-training on an established open-source base model, resulting in SNFinLLM-base. Following this, we engage in supervised fine-tuning (SFT) to bolster the model's capability across multiple financial tasks. Crucially, we employ a straightforward Direct Preference Optimization (DPO) method to better align the model with human preferences. Extensive experiments conducted on finance benchmarks and our evaluation dataset demonstrate that SNFinLLM markedly outperforms other state-of-the-art financial language models. For more details, check out our demo video here: https://www.youtube.com/watch?v=GYT-65HZwus.

翻译：大语言模型已成为推动金融行业自然语言处理应用的有力工具。然而，现有金融大语言模型常面临幻觉或参数训练浅表化等挑战，导致其性能欠佳，尤其在金融计算和机器阅读理解任务中。为解决这些问题，我们提出了一种专为中文金融领域设计的新型大语言模型，命名为SNFinLLM。该模型在回答提问、总结金融研究报告、情感分析和执行金融计算等特定领域任务中表现卓越。我们通过监督微调来增强模型在多个金融领域的专业能力。具体而言，我们收集了广泛的金融数据，构建了一个由新闻文章、专业论文和金融领域研究报告组成的高质量指令数据集。利用领域特定数据集和通用数据集，我们在一个成熟的开源基础模型上进行了持续预训练，得到了SNFinLLM-base模型。随后，我们通过监督微调进一步强化了模型在多种金融任务上的能力。关键的是，我们采用了一种简洁的直接偏好优化方法，以更好地使模型与人类偏好对齐。在金融基准测试和我们自建的评估数据集上进行的大量实验表明，SNFinLLM显著优于其他先进的金融语言模型。更多细节，请查看我们的演示视频：https://www.youtube.com/watch?v=GYT-65HZwus。