We present a lightweight system for stereo matching through embedded GPUs. It breaks the trade-off between accuracy and processing speed in stereo matching, enabling our embedded system to further improve the matching accuracy while ensuring real-time processing. The main idea of our method is to construct a tiny neural network based on variational auto-encoder (VAE) to upsample and refinement a small size of coarse disparity map, which is first generated by a traditional matching method. The proposed hybrid structure cannot only bring the advantage of traditional methods in terms of computational complexity, but also ensure the matching accuracy under the impact of neural network. Extensive experiments on the KITTI 2015 benchmark demonstrate that our tiny system exhibits high robustness in improving the accuracy of the coarse disparity maps generated by different algorithms, while also running in real-time on embedded GPUs.

翻译：我们提出了一种基于嵌入式GPU的轻量级立体匹配系统。该系统打破了立体匹配中精度与处理速度之间的权衡，使得我们的嵌入式系统能够在确保实时处理的同时进一步提升匹配精度。该方法的核心思想是构建一个基于变分自编码器（VAE）的微型神经网络，用于对由传统匹配方法首先生成的小尺寸粗略视差图进行上采样和细化。所提出的混合结构不仅能够继承传统方法在计算复杂度方面的优势，还能在神经网络的影响下保证匹配精度。在KITTI 2015基准数据集上的大量实验表明，我们的微型系统在提升不同算法生成的粗略视差图精度方面表现出高鲁棒性，同时能够在嵌入式GPU上实时运行。