As road accident cases are increasing due to the inattention of the driver, automated driver monitoring systems (DMS) have gained an increase in acceptance. In this report, we present a real-time DMS system that runs on a hardware-accelerator-based edge device. The system consists of an InfraRed camera to record the driver footage and an edge device to process the data. To successfully port the deep learning models to run on the edge device taking full advantage of the hardware accelerators, model surgery was performed. The final DMS system achieves 63 frames per second (FPS) on the TI-TDA4VM edge device.
翻译:随着因驾驶员注意力不集中导致的交通事故日益增多,自动化驾驶员监控系统(DMS)得到了越来越广泛的认可。本报告提出了一种在基于硬件加速器的边缘设备上运行的实时DMS系统。该系统由用于记录驾驶员画面的红外摄像头和处理数据的边缘设备组成。为成功将深度学习模型移植到边缘设备上并充分利用硬件加速器,我们对模型进行了"手术"(model surgery)。最终DMS系统在TI-TDA4VM边缘设备上实现了每秒63帧(FPS)的处理速度。