Video holds significance in computer graphics applications. Because of the heterogeneous of digital devices, retargeting videos becomes an essential function to enhance user viewing experience in such applications. In the research of video retargeting, preserving the relevant visual content in videos, avoiding flicking, and processing time are the vital challenges. Extending image retargeting techniques to the video domain is challenging due to the high running time. Prior work of video retargeting mainly utilizes time-consuming preprocessing to analyze frames. Plus, being tolerant of different video content, avoiding important objects from shrinking, and the ability to play with arbitrary ratios are the limitations that need to be resolved in these systems requiring investigation. In this paper, we present an end-to-end RETVI method to retarget videos to arbitrary aspect ratios. We eliminate the computational bottleneck in the conventional approaches by designing RETVI with two modules, content feature analyzer (CFA) and adaptive deforming estimator (ADE). The extensive experiments and evaluations show that our system outperforms previous work in quality and running time. Visit our project website for more results at http://graphics.csie.ncku.edu.tw/RETVI.
翻译:视频在计算机图形学应用中具有重要意义。由于数字设备的异构性,视频重定向成为提升此类应用用户观看体验的关键功能。在视频重定向研究中,保留视频中的相关视觉内容、避免闪烁现象以及处理时间是核心挑战。由于高运行时间的限制,将图像重定向技术扩展到视频领域颇具难度。以往的视频重定向工作主要依赖耗时的预处理来分析帧。此外,对不同视频内容的兼容性、避免重要对象被压缩,以及支持任意比例播放的能力,是此类系统亟需解决的限制因素。本文提出一种端到端的RETVI方法,可将视频重定向至任意宽高比。通过设计包含内容特征分析器(CFA)与自适应变形估计器(ADE)的RETVI模块,我们消除了传统方法中的计算瓶颈。大量实验与评估表明,本系统在质量与运行时间上均优于先前工作。更多结果请访问项目网站:http://graphics.csie.ncku.edu.tw/RETVI。