This paper proposes a visual multi-object tracking method that jointly employs stochastic and deterministic mechanisms to ensure identifier consistency for unknown and time-varying target numbers under nonlinear dynamics. A stochastic particle filter addresses nonlinear dynamics and non-Gaussian noise, with support from particle swarm optimization (PSO) to guide particles toward state distribution modes and mitigate divergence through proposed fitness measures incorporating motion consistency, appearance similarity, and social-interaction cues with neighboring targets. Deterministic association further enforces identifier consistency via a proposed cost matrix incorporating spatial consistency between particles and current detections, detection confidences, and track penalties. Subsequently, a novel scheme is proposed for the smooth updating of target states while preserving their identities, particularly for weak tracks during interactions with other targets and prolonged occlusions. Moreover, velocity regression over past states provides trend-seed velocities, enhancing particle sampling and state updates. The proposed tracker is designed to operate flexibly for both pre-recorded videos and camera live streams, where future frames are unavailable. Experimental results confirm superior performance compared to state-of-the-art trackers. The source-code reference implementations of both the proposed method and compared-trackers are provided on GitHub: https://github.com/SDU-VelKoTek/GenTrack2
翻译:本文提出一种视觉多目标跟踪方法,该方法联合采用随机与确定性机制,以确保非线性动态下未知且时变目标数量的标识符一致性。随机粒子滤波器处理非线性动态与非高斯噪声,并借助粒子群优化算法引导粒子朝向状态分布模态,通过融合运动一致性、外观相似度及与邻近目标社会交互线索的适应度度量来抑制发散。确定性关联进一步通过提出的成本矩阵强化标识符一致性,该矩阵融合了粒子与当前检测间的空间一致性、检测置信度及轨迹惩罚。随后,提出一种新颖方案用于目标状态的平滑更新,同时保持其身份标识,尤其针对目标交互期间及长期遮挡中的弱轨迹。此外,基于历史状态的速率回归提供趋势种子速率,以增强粒子采样与状态更新。所提跟踪器设计为可灵活适用于预录制视频与摄像头实时流两种场景,其中未来帧不可获取。实验结果证实了相较于现有先进跟踪器的优越性能。所提方法及对比跟踪器的源代码参考实现已发布于GitHub:https://github.com/SDU-VelKoTek/GenTrack2