In this study, we propose VibeCodeHPC, a multi-agent system based on large language models (LLMs) for the automatic tuning of high-performance computing (HPC) programs on supercomputers. VibeCodeHPC adopts Claude Code as its backend and provides an integrated environment that facilitates program development in supercomputer settings. The system not only brings the Vibe Coding paradigm -- program development through natural language interaction with users -- to HPC programming, but also enables autonomous performance optimization with minimal user intervention through a sophisticated multi-agent design. To achieve these objectives, VibeCodeHPC implements three core functionalities: (1) configuration capabilities tailored to the unique development environments of supercomputers, (2) collaborative operation among multiple LLM agents with distinct roles -- Project Manager (PM), System Engineer (SE), Programmer (PG), and Continuous Deliverer (CD), and (3) long-term autonomous operation through agent activity monitoring and dynamic deployment mechanisms. This paper highlights one of the most powerful features of VibeCodeHPC: fully automated code optimization through autonomous operation without user intervention. Specifically, it demonstrates the performance optimization of CPU-based codes on GPU-equipped systems for matrix multiplication and a Poisson equation solver using Jacobi's iterative method. The results show that the multi-agent configuration employed in VibeCodeHPC enables faster and more reliable development of higher-performance code compared to a single-agent setup.
翻译:本研究提出VibeCodeHPC,一种基于大语言模型的多代理系统,用于在超级计算机上自动调优高性能计算程序。VibeCodeHPC采用Claude Code作为后端,并提供一个集成环境,以促进超级计算机环境中的程序开发。该系统不仅将Vibe编码范式——即通过与用户进行自然语言交互来开发程序——引入高性能计算编程,还通过精妙的多代理设计,以最少的用户干预实现自主性能优化。为实现这些目标,VibeCodeHPC实现了三个核心功能:(1) 针对超级计算机独特开发环境量身定制的配置能力,(2) 具有不同角色——项目经理、系统工程师、程序员和持续交付者——的多个大语言模型代理之间的协同操作,以及(3) 通过代理活动监控和动态部署机制实现长期自主运行。本文重点介绍了VibeCodeHPC最强大的功能之一:通过自主运行实现完全自动化的代码优化,无需用户干预。具体而言,本文展示了在配备GPU的系统上对基于CPU的矩阵乘法和使用雅可比迭代法的泊松方程求解器代码进行性能优化的过程。结果表明,与单代理配置相比,VibeCodeHPC采用的多代理配置能够更快、更可靠地开发出性能更高的代码。