In this paper, we will present SketchQL, a video database management system (VDBMS) for retrieving video moments with a sketch-based query interface. This novel interface allows users to specify object trajectory events with simple mouse drag-and-drop operations. Users can use trajectories of single objects as building blocks to compose complex events. Using a pre-trained model that encodes trajectory similarity, SketchQL achieves zero-shot video moments retrieval by performing similarity searches over the video to identify clips that are the most similar to the visual query. In this demonstration, we introduce the graphic user interface of SketchQL and detail its functionalities and interaction mechanisms. We also demonstrate the end-to-end usage of SketchQL from query composition to video moments retrieval using real-world scenarios.
翻译:本文介绍SketchQL,一种基于草图查询界面检索视频片段的视频数据库管理系统(VDBMS)。该创新界面允许用户通过简单的鼠标拖放操作指定物体轨迹事件。用户可将单一物体的轨迹作为构建模块组合成复杂事件。通过使用预训练的轨迹相似度编码模型,SketchQL对视频执行相似性搜索以识别与视觉查询最相似的片段,从而实现零样本视频片段检索。本演示将介绍SketchQL的图形用户界面,详述其功能与交互机制,并通过真实场景展示从查询构建到视频片段检索的端到端使用流程。