Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning algorithms, we train the system to achieve successful puck interactions through reinforcement learning in a remarkably small number of trials. The network leverages fixed random connectivity to capture the task's temporal structure and adopts a local e-prop learning rule in the readout layer to exploit event-driven activity for fast and efficient learning. The result is real-time learning with a setup comprising a computer and the neuromorphic chip in-the-loop, enabling practical training of spiking neural networks for robotic autonomous systems. This work bridges neuroscience-inspired hardware with real-world robotic control, showing that brain-inspired approaches can tackle fast-paced interaction tasks while supporting always-on learning in intelligent machines.
翻译:空气曲棍球要求在高速冰球运动中进行瞬间决策,我们通过运行在混合信号模拟/数字神经形态处理器上的紧凑脉冲神经元网络来解决这一挑战。通过硬件与学习算法的协同设计,我们训练该系统在极少试验次数内通过强化学习实现成功的冰球交互。该网络利用固定随机连接捕捉任务的时间结构,并在读出层采用局部e-prop学习规则,以利用事件驱动活动实现快速高效的学习。最终构建了包含计算机和神经形态芯片的实时闭环学习系统,为机器人自主系统实现了脉冲神经网络的实际训练。这项工作将神经科学启发的硬件与现实世界的机器人控制相连接,表明受大脑启发的计算方法能够处理快节奏交互任务,同时支持智能机器中的持续在线学习。