Optical sensors have played a pivotal role in acquiring real world data for critical applications. This data, when integrated with advanced machine learning algorithms provides meaningful information thus enhancing human vision. This paper focuses on various optical technologies for design and development of state-of-the-art out-cabin forward vision systems and in-cabin driver monitoring systems. The focused optical sensors include Longwave Thermal Imaging (LWIR) cameras, Near Infrared (NIR), Neuromorphic/ event cameras, Visible CMOS cameras and Depth cameras. Further the paper discusses different potential applications which can be employed using the unique strengths of each these optical modalities in real time environment.
翻译:光学传感器在关键应用中获取现实世界数据方面发挥了关键作用。这些数据与先进机器学习算法集成后,能够提供有意义的信息,从而增强人类视觉感知。本文聚焦于多种光学技术,用于设计和开发最先进的舱外前方视觉系统以及舱内驾驶员监控系统。所关注的光学传感器包括长波热成像(LWIR)相机、近红外(NIR)相机、神经形态/事件相机、可见光CMOS相机以及深度相机。此外,本文讨论了利用每种光学模态在实时环境中的独特优势可以实现的多种潜在应用。