Optical metasurfaces composed of precisely engineered nanostructures have gained significant attention for their ability to manipulate light and implement distinct functionalities based on the properties of the incident field. Computational imaging systems have started harnessing this capability to produce sets of coded measurements that benefit certain tasks when paired with digital post-processing. Inspired by these works, we introduce a new system that uses a birefringent metasurface with a polarizer-mosaicked photosensor to capture four optically-coded measurements in a single exposure. We apply this system to the task of incoherent opto-electronic filtering, where digital spatial-filtering operations are replaced by simpler, per-pixel sums across the four polarization channels, independent of the spatial filter size. In contrast to previous work on incoherent opto-electronic filtering that can realize only one spatial filter, our approach can realize a continuous family of filters from a single capture, with filters being selected from the family by adjusting the post-capture digital summation weights. To find a metasurface that can realize a set of user-specified spatial filters, we introduce a form of gradient descent with a novel regularizer that encourages light efficiency and a high signal-to-noise ratio. We demonstrate several examples in simulation and with fabricated prototypes, including some with spatial filters that have prescribed variations with respect to depth and wavelength. Visit the Project Page at https://deanhazineh.github.io/publications/Multi_Image_Synthesis/MIS_Home.html
翻译:由精密设计的纳米结构构成的光学超表面,因其基于入射场特性调控光并实现不同功能的能力而受到广泛关注。计算成像系统已开始利用这一能力产生编码测量集,配合数字后处理可提升特定任务的性能。受这些研究的启发,我们提出了一种新系统:利用双折射超表面与偏振器马赛克光电传感器,在单次曝光中捕获四幅光学编码测量图像。我们将该系统应用于非相干光电滤波任务,其中数字空间滤波操作被简化为跨四个偏振通道的逐像素求和,其计算复杂度与空间滤波器的尺寸无关。与先前仅能实现单一空间滤波器的非相干光电滤波工作不同,我们的方法可通过单次捕获实现连续滤波器族,通过调整后捕获数字求和权重从该族中选取滤波器。为设计能实现用户指定空间滤波器组的超表面,我们引入了一种梯度下降算法,并配合新颖的正则化项以提升光效率和高信噪比。我们通过仿真和原型实验展示了多个示例,包括具有深度和波长依赖的预设空间滤波器。项目页面请访问 https://deanhazineh.github.io/publications/Multi_Image_Synthesis/MIS_Home.html