Autonomous driving demands an integrated approach that encompasses perception, prediction, and planning, all while operating under strict energy constraints to enhance scalability and environmental sustainability. We present Spiking Autonomous Driving (\name{}), the first unified Spiking Neural Network (SNN) to address the energy challenges faced by autonomous driving systems through its event-driven and energy-efficient nature. SAD is trained end-to-end and consists of three main modules: perception, which processes inputs from multi-view cameras to construct a spatiotemporal bird's eye view; prediction, which utilizes a novel dual-pathway with spiking neurons to forecast future states; and planning, which generates safe trajectories considering predicted occupancy, traffic rules, and ride comfort. Evaluated on the nuScenes dataset, SAD achieves competitive performance in perception, prediction, and planning tasks, while drawing upon the energy efficiency of SNNs. This work highlights the potential of neuromorphic computing to be applied to energy-efficient autonomous driving, a critical step toward sustainable and safety-critical automotive technology. Our code is available at \url{https://github.com/ridgerchu/SAD}.
翻译:自动驾驶需要一种集感知、预测与规划于一体的综合方法,同时需在严格的能量约束下运行,以提升可扩展性与环境可持续性。本文提出脉冲自动驾驶(SAD),这是首个统一的脉冲神经网络(SNN)框架,通过其事件驱动与高能效的特性应对自动驾驶系统面临的能量挑战。SAD采用端到端训练,包含三个核心模块:感知模块处理多视角相机输入以构建时空鸟瞰图;预测模块采用新型双通路脉冲神经元结构来预测未来状态;规划模块则综合考虑预测占据、交通规则与乘坐舒适度以生成安全轨迹。在nuScenes数据集上的评估表明,SAD在感知、预测与规划任务中均取得具有竞争力的性能,同时充分发挥了SNN的能效优势。这项工作凸显了神经形态计算应用于高能效自动驾驶的潜力,是迈向可持续且安全攸关的汽车技术的关键一步。代码发布于\url{https://github.com/ridgerchu/SAD}。