Co-design is a prominent topic presently in computing, speaking to the mutual benefit of coordinating design choices of several layers in the technology stack. For example, this may be designing algorithms which can most efficiently take advantage of the acceleration properties of a given architecture, while simultaneously designing the hardware to support the structural needs of a class of computation. The implications of these design decisions are influential enough to be deemed a lottery, enabling an idea to win out over others irrespective of the individual merits. Coordination is a well studied topic in the mathematics of game theory, where in many cases without a coordination mechanism the outcome is sub-optimal. Here we consider what insights game theoretic analysis can offer for computer architecture co-design. In particular, we consider the interplay between algorithm and architecture advances in the field of neuromorphic computing. Analyzing developments of spiking neural network algorithms and neuromorphic hardware as a co-design game we use the Stag Hunt model to illustrate challenges for spiking algorithms or architectures to advance the field independently and advocate for a strategic pursuit to advance neuromorphic computing.
翻译:协同设计是当前计算领域的重要议题,强调技术栈多层设计决策协调的互利性。例如:既需设计能高效利用特定架构加速特性的算法,又要同步设计支持某类计算结构需求的硬件。这些设计决策的影响深远,足以被视为一场"设计彩票"——即使缺乏个体优势,特定方案仍可能因协调效应胜出。协调机制是博弈论数学中研究充分的课题,大量案例表明缺乏协调机制时往往产生次优结果。本文探讨博弈论分析能为计算机架构协同设计提供何种洞见,特别聚焦神经形态计算领域算法与架构的相互作用。通过将脉冲神经网络算法与神经形态硬件的发展视为协同设计博弈,我们运用"猎鹿博弈模型"揭示:若脉冲算法与架构各自独立推进,将面临发展困境。据此,我们倡导通过战略合作推动神经形态计算领域的系统性进步。