Anticipating the intentions of Vulnerable Road Users (VRUs) is a critical challenge for safe autonomous driving (AD) and mobile robotics. While current research predominantly focuses on pedestrian crossing behaviors from a vehicle's perspective, interactions within dense shared spaces remain underexplored. To bridge this gap, we introduce FUSE-Bike, the first fully open perception platform of its kind. Equipped with two LiDARs, a camera, and GNSS, it facilitates high-fidelity, close-range data capture directly from a cyclist's viewpoint. Leveraging this platform, we present BikeActions, a novel multi-modal dataset comprising 852 annotated samples across 5 distinct action classes, specifically tailored to improve VRU behavior modeling. We establish a rigorous benchmark by evaluating state-of-the-art graph convolution and transformer-based models on our publicly released data splits, establishing the first performance baselines for this challenging task. We release the full dataset together with data curation tools, the open hardware design, and the benchmark code to foster future research in VRU action understanding under https://iv.ee.hm.edu/bikeactions/.
翻译:预测弱势道路使用者(VRUs)的意图是实现安全自动驾驶(AD)与移动机器人技术的关键挑战。当前研究主要从车辆视角关注行人横穿行为,而对密集共享空间内的交互行为仍缺乏深入探索。为填补这一空白,我们推出了首个完全开放的感知平台FUSE-Bike。该平台配备两台激光雷达、一个摄像头及GNSS系统,能够直接从骑行者视角采集高保真、近距离数据。基于此平台,我们构建了BikeActions——一个包含852个标注样本、涵盖5个不同动作类别的创新多模态数据集,专门用于优化VRU行为建模。我们通过评估最先进的图卷积与基于Transformer的模型在公开数据划分上的表现,建立了严谨的性能基准,为此挑战性任务设立了首个性能基线。我们完整公开了数据集、数据管理工具、开放硬件设计方案及基准代码,以促进VRU行为理解领域的未来研究,访问地址:https://iv.ee.hm.edu/bikeactions/。