Large Language Models (LLMs) have recently shown remarkable capabilities in various software engineering tasks, spurring the rapid growth of the Large Language Models for Software Engineering (LLM4SE) area. However, limited attention has been paid to developing efficient LLM4SE techniques that demand minimal computational cost, time, and memory resources, as well as green LLM4SE solutions that reduce energy consumption, water usage, and carbon emissions. This paper aims to redirect the focus of the research community towards the efficiency and greenness of LLM4SE, while also sharing potential research directions to achieve this goal. It commences with a brief overview of the significance of LLM4SE and highlights the need for efficient and green LLM4SE solutions. Subsequently, the paper presents a vision for a future where efficient and green LLM4SE revolutionizes the LLM-based software engineering tool landscape, benefiting various stakeholders, including industry, individual practitioners, and society. The paper then delineates a roadmap for future research, outlining specific research paths and potential solutions for the research community to pursue. While not intended to be a definitive guide, the paper aims to inspire further progress, with the ultimate goal of establishing efficient and green LLM4SE as a central element in the future of software engineering.
翻译:大语言模型(LLMs)近期在各类软件工程任务中展现出卓越能力,推动了软件工程大语言模型(LLM4SE)领域的快速发展。然而,当前研究对开发计算成本、时间与内存资源需求最小化的高效LLM4SE技术,以及降低能耗、水资源消耗与碳排放的绿色LLM4SE解决方案关注有限。本文旨在引导研究社群重新聚焦于LLM4SE的效率与绿色性,并分享实现该目标的潜在研究方向。文章首先概述LLM4SE的重要意义,强调发展高效绿色LLM4SE解决方案的必要性;继而展望高效绿色LLM4SE革新基于LLM的软件工程工具生态的未来愿景,阐明其对产业界、从业者及社会等多方利益相关者的积极影响。随后,本文勾勒出未来研究的路线图,为研究社群指明具体的研究路径与潜在解决方案。本文虽非终极指南,但期望能激发后续探索,最终推动高效绿色LLM4SE成为未来软件工程的核心组成部分。