The First Perception Test challenge was held as a half-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2023, with the goal of benchmarking state-of-the-art video models on the recently proposed Perception Test benchmark. The challenge had six tracks covering low-level and high-level tasks, with both a language and non-language interface, across video, audio, and text modalities, and covering: object tracking, point tracking, temporal action localisation, temporal sound localisation, multiple-choice video question-answering, and grounded video question-answering. We summarise in this report the task descriptions, metrics, baselines, and results.

翻译：首届感知测试挑战赛作为IEEE/CVF国际计算机视觉大会（ICCV 2023）的半日研讨会同期举行，其目标是在近期提出的感知测试基准上对最先进的视频模型进行基准测试。挑战赛设有六个赛道，涵盖底层与高层任务，支持语言与非语言两种交互界面，涉及视频、音频和文本模态，具体包括：目标跟踪、点跟踪、时序动作定位、时序声音定位、多项选择视频问答以及基于grounded的视频问答。本报告总结了各任务描述、评估指标、基线方法和实验结果。