Curriculum Learning (CL), drawing inspiration from natural learning patterns observed in humans and animals, employs a systematic approach of gradually introducing increasingly complex training data during model development. Our work applies innovative CL methodologies to address the challenging geometric problem of monocular Visual Odometry (VO) estimation, which is essential for robot navigation in constrained environments. The primary objective of our research is to push the boundaries of current state-of-the-art (SOTA) benchmarks in monocular VO by investigating various curriculum learning strategies. We enhance the end-to-end Deep-Patch-Visual Odometry (DPVO) framework through the integration of novel CL approaches, with the goal of developing more resilient models capable of maintaining high performance across challenging environments and complex motion scenarios. Our research encompasses several distinctive CL strategies. We develop methods to evaluate sample difficulty based on trajectory motion characteristics, implement sophisticated adaptive scheduling through self-paced weighted loss mechanisms, and utilize reinforcement learning agents for dynamic adjustment of training emphasis. Through comprehensive evaluation on the diverse synthetic TartanAir dataset and complex real-world benchmarks such as EuRoC and TUM-RGBD, our Curriculum Learning-based Deep-Patch-Visual Odometry (CL-DPVO) demonstrates superior performance compared to existing SOTA methods, including both feature-based and learning-based VO approaches. The results validate the effectiveness of integrating curriculum learning principles into visual odometry systems.
翻译:课程学习借鉴了人类和动物自然学习模式的启发,采用在模型训练过程中逐步引入日益复杂数据的系统化方法。本研究应用创新的课程学习方法来解决单目视觉里程计这一具有挑战性的几何估计问题,该技术对于机器人在受限环境中的导航至关重要。本研究的主要目标是通过探索多种课程学习策略,突破当前单目视觉里程计领域最先进基准的性能边界。我们通过整合新颖的课程学习方法,改进了端到端的Deep-Patch-Visual Odometry框架,旨在开发更具鲁棒性的模型,使其能够在挑战性环境和复杂运动场景中保持优异性能。我们的研究涵盖多种独特的课程学习策略:开发了基于轨迹运动特征评估样本难度的方法,通过自步加权损失机制实现精细的自适应调度,并利用强化学习智能体动态调整训练重点。通过在多样化的合成数据集TartanAir以及复杂的真实世界基准数据集EuRoC和TUM-RGBD上进行全面评估,我们提出的基于课程学习的Deep-Patch-Visual Odometry方法相较于现有最先进方法(包括基于特征和基于学习的视觉里程计方法)均表现出更优越的性能。实验结果验证了将课程学习原理融入视觉里程计系统的有效性。