Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon-cubes represent the spatio-temporal detections of photons as a sequence of binary frames, at frame-rates as high as 100 kHz. We show that simple transformations of the photon-cube, or photon-cube projections, provide the functionality of numerous imaging systems including: exposure bracketing, flutter shutter cameras, video compressive systems, event cameras, and even cameras that move during exposure. Our photon-cube projections offer the flexibility of being software-defined constructs that are only limited by what is computable, and shot-noise. We exploit this flexibility to provide new capabilities for the emulated cameras. As an added benefit, our projections provide camera-dependent compression of photon-cubes, which we demonstrate using an implementation of our projections on a novel compute architecture that is designed for single-photon imaging.
翻译:可重解释相机的核心在于其超越传统成像的后处理能力。我们提出“SoDaCam”技术,通过单光子器件采集的光子立方体,在光子粒度上实现可重解释相机。光子立方体以高达100 kHz的帧率将光子的时空检测记录为二进制帧序列。研究表明,对光子立方体进行简单变换(即光子立方体投影)可模拟多种成像系统的功能,包括:曝光包围、快门闪光相机、视频压缩系统、事件相机,甚至运动曝光相机。我们的光子立方体投影具有软件定义结构的灵活性,其能力仅受限于计算可行性与散粒噪声。我们利用这一灵活性为模拟相机提供新型功能。此外,这些投影还能实现依赖相机的光子立方体压缩,通过专为单光子成像设计的新型计算架构部署我们的投影方案,验证了该方法的有效性。