Recent advances in large language model-powered multi-agent systems have demonstrated remarkable collective intelligence through effective communication. However, existing approaches face two primary challenges: (i) \textit{Ineffective group collaboration modeling}, as they rely on pairwise edge representations in graph structures, limiting their ability to capture relationships among multiple agents; and (ii) \textit{Limited task-adaptiveness in communication topology design}, leading to excessive communication cost for simple tasks and insufficient coordination for complex scenarios. These issues restrict the scalability and practical deployment of adaptive collaboration frameworks. To address these challenges, we propose \textbf{HyperAgent}, a hypergraph-based framework that optimizes communication topologies and effectively captures group collaboration patterns using direct hyperedge representations. Unlike edge-based approaches, HyperAgent uses hyperedges to link multiple agents within the same subtask and employs hypergraph convolutional layers to achieve one-step information aggregation in collaboration groups. Additionally, it incorporates a variational autoencoder framework with sparsity regularization to dynamically adjust hypergraph topologies based on task complexity. Experiments highlight the superiority of HyperAgent in both performance and efficiency. For instance, on GSM8K, HyperAgent achieves 95.07\% accuracy while reducing token consumption by 25.33\%, demonstrating the potential of hypergraph-based optimization for multi-agent communication.

翻译：近年来，基于大语言模型的多智能体系统通过有效通信展现了卓越的集体智能。然而，现有方法面临两大主要挑战：（i）\textit{群体协作建模效率低下}，因其依赖图结构中的成对边表示，限制了捕捉多智能体间关系的能力；（ii）\textit{通信拓扑设计中的任务适应性有限}，导致简单任务中通信开销过大，而复杂场景下协调不足。这些问题制约了自适应协作框架的可扩展性与实际部署。为应对这些挑战，我们提出\textbf{HyperAgent}，一种基于超图的框架，该框架利用直接超边表示优化通信拓扑并有效捕捉群体协作模式。与基于边的方法不同，HyperAgent使用超边连接同一子任务内的多个智能体，并采用超图卷积层实现协作组内的一步信息聚合。此外，它结合了带有稀疏正则化的变分自编码器框架，以根据任务复杂度动态调整超图拓扑。实验凸显了HyperAgent在性能与效率上的优越性。例如，在GSM8K数据集上，HyperAgent实现了95.07\%的准确率，同时将令牌消耗降低了25.33\%，这证明了基于超图的优化在多智能体通信中的潜力。