Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. As an outstanding representative of LLMs and the foundation model that set off this wave of research on LLMs, ChatGPT has attracted more and more researchers to study its capabilities and performance on various downstream Natural Language Processing (NLP) tasks. While marveling at ChatGPT's incredible performance on kinds of tasks, we notice that ChatGPT also has excellent multilingual processing capabilities, such as Chinese. To explore the Chinese processing ability of ChatGPT, we focus on Chinese Text Correction, a fundamental and challenging Chinese NLP task. Specifically, we evaluate ChatGPT on the Chinese Grammatical Error Correction (CGEC) and Chinese Spelling Check (CSC) tasks, which are two main Chinese Text Correction scenarios. From extensive analyses and comparisons with previous state-of-the-art fine-tuned models, we empirically find that the ChatGPT currently has both amazing performance and unsatisfactory behavior for Chinese Text Correction. We believe our findings will promote the landing and application of LLMs in the Chinese NLP community.

翻译：近期，大型语言模型（LLMs）的发展与进步震惊了整个人工智能领域。作为LLMs的杰出代表及引发此波LLM研究浪潮的基础模型，ChatGPT吸引了越来越多研究者探索其在各种下游自然语言处理（NLP）任务中的能力与表现。在对ChatGPT在各类任务上的惊人表现赞叹之余，我们注意到其还具备卓越的多语言处理能力，例如中文。为探究ChatGPT的中文处理能力，我们聚焦于中文文本修正这一基础且具挑战性的中文NLP任务。具体而言，我们在中文语法错误纠正（CGEC）和中文拼写检查（CSC）这两个主要的中文文本修正场景中评估了ChatGPT。通过广泛的分析及与先前最优微调模型的对比，我们经验性发现：当前ChatGPT在中文文本修正中既展现出惊艳性能，亦存在不尽如人意的行为。我们相信，这一发现将推动LLMs在中文NLP领域的落地与应用。