In the modern era where software plays a pivotal role, software security and vulnerability analysis have become essential for software development. Fuzzing test, as an efficient software testing method, are widely used in various domains. Moreover, the rapid development of Large Language Models (LLMs) has facilitated their application in the field of software testing, demonstrating remarkable performance. Considering that existing fuzzing test techniques are not entirely automated and software vulnerabilities continue to evolve, there is a growing trend towards employing fuzzing test generated based on large language models. This survey provides a systematic overview of the approaches that fuse LLMs and fuzzing tests for software testing. In this paper, a statistical analysis and discussion of the literature in three areas, namely LLMs, fuzzing test, and fuzzing test generated based on LLMs, are conducted by summarising the state-of-the-art methods up until 2024. Our survey also investigates the potential for widespread deployment and application of fuzzing test techniques generated by LLMs in the future.
翻译:在现代软件扮演关键角色的时代,软件安全与漏洞分析已成为软件开发的核心环节。模糊测试作为一种高效的软件测试方法,已被广泛运用于各个领域。此外,大语言模型的快速发展推动了其在软件测试领域的应用,展现出卓越的性能。鉴于现有模糊测试技术尚未实现完全自动化,且软件漏洞持续演进,基于大语言模型生成的模糊测试技术正日益成为主流趋势。本综述系统梳理了融合大语言模型与模糊测试的软件测试方法。通过对截至2024年的前沿技术进行文献计量分析,本文从大语言模型、模糊测试和基于大语言模型的模糊测试生成三个维度展开统计分析与讨论。本综述还探究了未来大语言模型生成模糊测试技术的广泛部署与应用潜力。