Unlike traditional artificial neural networks (ANNs), biological neuronal networks solve complex cognitive tasks with sparse neuronal activity, recurrent connections, and local learning rules. These mechanisms serve as design principles in Neuromorphic computing, which addresses the critical challenge of energy consumption in modern computing. However, most mixed-signal neuromorphic devices rely on semi- or unsupervised learning rules, which are ineffective for optimizing hardware in supervised learning tasks. This lack of scalable solutions for on-chip learning restricts the potential of mixed-signal devices to enable sustainable, intelligent edge systems. To address these challenges, we present a novel learning algorithm for Spiking Neural Networks (SNNs) on mixed-signal devices that integrates spike-based weight updates with feedback control signals. In our framework, a spiking controller generates feedback signals to guide SNN activity and drive weight updates, enabling scalable and local on-chip learning. We first evaluate the algorithm on various classification tasks, demonstrating that single-layer SNNs trained with feedback control achieve performance comparable to artificial neural networks (ANNs). We then assess its implementation on mixed-signal neuromorphic devices by testing network performance in continuous online learning scenarios and evaluating resilience to hyperparameter mismatches. Our results show that the feedback control optimizer is compatible with neuromorphic applications, advancing the potential for scalable, on-chip learning solutions in edge applications.
翻译:与传统人工神经网络(ANN)不同,生物神经元网络通过稀疏的神经元活动、循环连接和局部学习规则解决复杂认知任务。这些机制构成了神经形态计算的设计原则,旨在应对现代计算中能耗这一关键挑战。然而,大多数混合信号神经形态器件依赖于半监督或无监督学习规则,这些规则在监督学习任务中难以有效优化硬件。片上学习缺乏可扩展解决方案,限制了混合信号器件实现可持续智能边缘系统的潜力。为应对这些挑战,我们提出一种适用于混合信号器件的脉冲神经网络(SNN)新型学习算法,该算法将基于脉冲的权重更新与反馈控制信号相结合。在我们的框架中,脉冲控制器生成反馈信号以引导SNN活动并驱动权重更新,从而实现可扩展的局部片上学习。我们首先在多种分类任务上评估该算法,结果表明采用反馈控制训练的单层SNN性能可与人工神经网络(ANN)相媲美。随后通过测试网络在连续在线学习场景中的性能,并评估其对超参数失配的鲁棒性,进一步考察其在混合信号神经形态器件上的实现效果。实验证明该反馈控制优化器与神经形态应用兼容,推动了边缘应用中可扩展片上学习解决方案的发展潜力。