Heterogeneous air-ground robot teams combine complementary sensing modalities, mobility characteristics, and spatial viewpoints that can significantly enhance perception in complex outdoor environments. However, progress in multi-robot collaborative perception has been constrained by the lack of real-world datasets featuring overlapping multi-modal observations from platforms operating in unstructured terrain. We present GA3T (Ground-Aerial Team for Terrain Traversal), a real-world multi-robot collaborative perception dataset collected using a Clearpath Husky UGV and an Autel EVO~II UAV across diverse unstructured environments, including forest trails, rocky paths, muddy terrain, snow piles, and grass-covered fields. The ground platform provides 3D LiDAR, stereo camera, IMU, and GPS data, while the aerial platform contributes RGB imagery, thermal/infrared observations, and GPS from a complementary overhead viewpoint, allowing for rich cross-modal and cross-view perception. The dataset is collected in 4 unique environments, with over 13,000 synchronized frames across approximately 29 minutes of operation, and includes both SAM~3-based zero-shot segmentation and over 8,000 manually labeled images. A unique aspect of the dataset is its early-spring collection period, during which sparse tree canopies allow the aerial robot to partially observe the ground robot and terrain through the trees, allowing for occlusion-aware collaborative perception. Unlike prior multi-robot datasets that focus on SLAM or simulated cooperative driving, GA3T is specifically designed to support research on cross-view perception, air-ground viewpoint fusion, traversability estimation, and collaborative scene understanding in real off-road environments.
翻译:异构空地机器人团队结合了互补的感知模态、移动特性和空间视角,能够显著增强复杂室外环境中的感知能力。然而,多机器人协同感知的进展受到缺乏来自非结构化地形中运行平台的重叠多模态观测的真实世界数据集的制约。我们提出了GA3T(地面-空中团队地形穿越),这是一个使用Clearpath Husky UGV和Autel EVO~II UAV在多种非结构化环境中收集的真实世界多机器人协同感知数据集,包括森林小径、岩石路径、泥泞地形、雪堆和草地覆盖区域。地面平台提供3D LiDAR、立体相机、IMU和GPS数据,而空中平台从互补的俯视视角贡献RGB图像、热红外观测和GPS数据,实现了丰富的跨模态和跨视角感知。数据集在4个独特环境中收集,包含超过13,000个同步帧,运行约29分钟,并包括基于SAM~3的零样本分割和超过8,000张手动标注图像。该数据集的一个独特之处在于其早春采集期,在此期间稀疏的树冠使得空中机器人能够部分通过树木观测地面机器人和地形,从而支持遮挡感知的协同感知。与以往专注于SLAM或模拟协同驾驶的多机器人数据集不同,GA3T专门设计用于支持真实越野环境中跨视角感知、空地视角融合、可通行性估计和协同场景理解的研究。