Neuromorphic vision made significant progress in recent years, thanks to the natural match between spiking neural networks and event data in terms of biological inspiration, energy savings, latency and memory use for dynamic visual data processing. However, optimising its energy requirements still remains a challenge within the community, especially for embedded applications. One solution may reside in preprocessing events to optimise data quantity thus lowering the energy cost on neuromorphic hardware, proportional to the number of synaptic operations. To this end, we extend an end-to-end neuromorphic line detection mechanism to introduce line-based event data preprocessing. Our results demonstrate on three benchmark event-based datasets that preprocessing leads to an advantageous trade-off between energy consumption and classification performance. Depending on the line-based preprocessing strategy and the complexity of the classification task, we show that one can maintain or increase the classification accuracy while significantly reducing the theoretical energy consumption. Our approach systematically leads to a significant improvement of the neuromorphic classification efficiency, thus laying the groundwork towards a more frugal neuromorphic computer vision thanks to event preprocessing.
翻译:近年来,神经形态视觉取得了显著进展,这得益于脉冲神经网络与事件数据在动态视觉数据处理方面的生物启发性、节能性、低延迟性和内存使用效率上的天然匹配。然而,优化其能量需求仍然是该领域面临的一个挑战,尤其是在嵌入式应用中。一种可能的解决方案在于对事件进行预处理,以优化数据量,从而降低神经形态硬件上的能量成本——该成本与突触操作的数量成正比。为此,我们扩展了一种端到端的神经形态线检测机制,引入了基于线的事件数据预处理。我们在三个基于事件的基准数据集上的结果表明,预处理能在能量消耗和分类性能之间实现有利的权衡。根据所采用的基于线的预处理策略和分类任务的复杂度,我们证明可以在显著降低理论能量消耗的同时,保持甚至提高分类准确率。我们的方法系统地显著提升了神经形态分类的效率,从而为通过事件预处理实现更节约的神经形态计算机视觉奠定了基础。