We present a novel approach for action recognition in UAV videos. Our formulation is designed to handle occlusion and viewpoint changes caused by the movement of a UAV. We use the concept of mutual information to compute and align the regions corresponding to human action or motion in the temporal domain. This enables our recognition model to learn from the key features associated with the motion. We also propose a novel frame sampling method that uses joint mutual information to acquire the most informative frame sequence in UAV videos. We have integrated our approach with X3D and evaluated the performance on multiple datasets. In practice, we achieve 18.9% improvement in Top-1 accuracy over current state-of-the-art methods on UAV-Human(Li et al., 2021), 7.3% improvement on Drone-Action(Perera et al., 2019), and 7.16% improvement on NEC Drones(Choi et al., 2020). We will release the code at the time of publication

翻译：我们提出了一种新颖的无人机视频动作识别方法。该方案专为处理无人机运动导致的遮挡和视角变化而设计。我们利用互信息概念，在时域上计算并对齐与人体动作或运动相对应的区域，从而使识别模型能够从与运动相关的关键特征中学习。此外，我们提出了一种新颖的帧采样方法，该方法采用联合互信息获取无人机视频中信息量最丰富的帧序列。我们将该方法与X3D模型集成，并在多个数据集上评估了性能。实际应用中，我们在UAV-Human数据集（Li等人，2021）上的Top-1准确率相比当前最先进方法提升了18.9%，在Drone-Action数据集（Perera等人，2019）上提升了7.3%，在NEC Drones数据集（Choi等人，2020）上提升了7.16%。代码将在发表时公开。