Bio-inspired neuromorphic cameras asynchronously record pixel brightness changes and generate sparse event streams. They can capture dynamic scenes with little motion blur and more details in extreme illumination conditions. Due to the multidimensional address-event structure, most existing vision algorithms cannot properly handle asynchronous event streams. While several event representations and processing methods have been developed to address such an issue, they are typically driven by a large number of events, leading to substantial overheads in runtime and memory. In this paper, we propose a new graph representation of the event data and couple it with a Graph Transformer to perform accurate neuromorphic classification. Extensive experiments show that our approach leads to better results and excels at the challenging realistic situations where only a small number of events and limited computational resources are available, paving the way for neuromorphic applications embedded into mobile facilities.

翻译：受生物启发的神经形态相机异步记录像素亮度变化并生成稀疏事件流。它们能够捕捉动态场景，在极端光照条件下运动模糊更少、细节更丰富。由于多维地址事件结构，大多数现有视觉算法无法正确处理异步事件流。尽管已有多种事件表示与处理方法被提出以解决该问题，但这些方法通常需要大量事件驱动，导致运行时和内存开销显著。本文提出了一种新的事件数据图表示，并将其与图Transformer（Graph Transformer）结合，以实现精确的神经形态分类。大量实验表明，我们的方法在仅有限事件和计算资源的挑战性现实场景中表现更优，为嵌入移动设备的神经形态应用铺平了道路。