In the field of multi-object tracking (MOT), recent Transformer based end-to-end models like MOTR have demonstrated exceptional performance on datasets such as DanceTracker. However, the computational demands of these models present challenges in training and deployment. Drawing inspiration from successful models like GPT, we present MO-YOLO, an efficient and computationally frugal end-to-end MOT model. MO-YOLO integrates principles from You Only Look Once (YOLO) and RT-DETR, adopting a decoder-only approach. By leveraging the decoder from RT-DETR and architectural components from YOLOv8, MO-YOLO achieves high speed, shorter training times, and proficient MOT performance. On the Dancetrack, MO-YOLO not only matches MOTR's performance but also surpasses it, achieving over twice the frames per second (MOTR 9.5 FPS, MO-YOLO 19.6 FPS). Furthermore, MO-YOLO demonstrates significantly reduced training times and lower hardware requirements compared to MOTR. This research introduces a promising paradigm for efficient end-to-end MOT, emphasizing enhanced performance and resource efficiency.
翻译:在多目标跟踪(MOT)领域,近年来基于Transformer的端到端模型(如MOTR)在DanceTracker等数据集上展现了卓越性能。然而,这些模型的计算需求给训练和部署带来了挑战。受GPT等成功模型的启发,我们提出了MO-YOLO——一种高效且计算经济的端到端MOT模型。MO-YOLO融合了You Only Look Once(YOLO)与RT-DETR的原理,采用仅解码器方法。通过利用RT-DETR的解码器以及YOLOv8的架构组件,MO-YOLO实现了高速度、更短的训练时间以及出色的MOT性能。在Dancetrack数据集上,MO-YOLO不仅与MOTR性能相当,更超越后者,帧率提升超过两倍(MOTR为9.5 FPS,MO-YOLO为19.6 FPS)。此外,与MOTR相比,MO-YOLO在训练时间和硬件需求上均显著降低。本研究为高效端到端MOT提出了一种有前景的新范式,强调了性能增强与资源效率并重的理念。