Following the successful 2023 edition, we organised the Second Perception Test challenge as a half-day workshop alongside the IEEE/CVF European Conference on Computer Vision (ECCV) 2024, with the goal of benchmarking state-of-the-art video models and measuring the progress since last year using the Perception Test benchmark. This year, the challenge had seven tracks (up from six last year) and covered low-level and high-level tasks, with language and non-language interfaces, across video, audio, and text modalities; the additional track covered hour-long video understanding and introduced a novel video QA benchmark 1h-walk VQA. Overall, the tasks in the different tracks were: object tracking, point tracking, temporal action localisation, temporal sound localisation, multiple-choice video question-answering, grounded video question-answering, and hour-long video question-answering. We summarise in this report the challenge tasks and results, and introduce in detail the novel hour-long video QA benchmark 1h-walk VQA.

翻译：继2023年成功举办后，我们在IEEE/CVF欧洲计算机视觉会议（ECCV）2024期间组织了第二届感知测试挑战赛作为为期半天的研讨会，旨在利用感知测试基准对最先进的视频模型进行基准测试，并衡量自去年以来的进展。今年，挑战赛设有七个赛道（去年为六个），涵盖低层和高层任务，涉及视频、音频和文本模态，并包含语言和非语言接口；新增赛道专注于长达一小时的视频理解，并引入了一个新型视频问答基准1h-walk VQA。总体而言，各赛道的任务包括：目标跟踪、点跟踪、时序动作定位、时序声音定位、多项选择视频问答、基于定位的视频问答以及一小时长视频问答。本报告总结了挑战赛的任务与结果，并详细介绍了新型一小时长视频问答基准1h-walk VQA。