In this paper, we report the world's first infrastructure-guided communication-enhanced road crack detection pipeline that is effective and implementable on passenger vehicles. We first design a customized communication protocol to transmit the region of interest from the infrastructure to the vehicle. With proper camera image processing (e.g., dynamic cropping and frame selection), the focused images are provided to the crack detection model. Leveraging state-of-the-art crack detection model backbones and a carefully prepared dataset comprising a forward-facing view with a crack, we train the model to improve crack-detection performance. We demonstrate the full detection pipeline on an experimental vehicle platform, showcase the detection effectiveness, and project future research directions.
翻译:本文首次报道了全球首个基于基础设施引导的通信增强型道路裂缝检测流水线,该方案可在乘用车上有效实施。我们首先设计定制化通信协议,将感兴趣区域从基础设施传输至车辆。通过适当的摄像头图像处理(如动态裁剪与帧选择),聚焦后的图像被输入裂缝检测模型。结合最先进的裂缝检测模型主干网络及精心构建的包含前视裂缝图像的专用数据集,我们对模型进行训练以提升裂缝检测性能。我们在实验车辆平台上演示了完整检测流水线,验证了检测有效性,并展望了未来研究方向。