Video outpainting generates plausible visual content beyond the original spatial extent of a video, playing a key role in adapting videos to diverse display formats. To support such use cases, it must enable large spatial extrapolation over long sequences. However, most existing methods address only one of these challenges or lack explicit mechanisms for ensuring global spatio-temporal consistency, leading to notable limitations. In this paper, we propose HL-OutPaint, a high-resolution video outpainting framework for long sequences. Our approach follows a coarse-to-fine strategy with a two-stage pipeline. We first construct Global Coarse Guidance (GCG), a low-resolution representation that captures global structure and dominant motion across the video. Unlike naive downsampling, GCG is built via a novel global-local frame swapping mechanism that couples sparse global keyframes with local temporal windows and exchanges information during sampling. This enables GCG to encode both long-term structural consistency and short-term temporal dynamics in a unified representation. Guided by this representation, HL-OutPaint then performs high-resolution outpainting to generate spatially detailed and temporally consistent content. By separating global structure modeling from fine-grained synthesis, our framework achieves stable, coherent generation for large spatial expansion and long video sequences. Extensive experiments show that HL-OutPaint outperforms existing methods in challenging scenarios involving wide spatial extrapolation and long video sequences.
翻译:视频外扩技术旨在生成原始视频空间范围之外的合理视觉内容,在将视频适配至多样化显示格式方面发挥着关键作用。为支持此类应用场景,该技术需实现对长序列的大范围空间外推。然而,现有大部分方法仅能解决其中一个挑战,或缺乏确保全局时空一致性的显式机制,导致显著局限性。本文提出HL-OutPaint——面向长序列的高分辨率视频外扩框架。本方法遵循粗到精策略,采用两阶段流水线架构:首先构建全局粗粒度引导(GCG),这是一种捕捉视频全局结构与主导运动的低分辨率表征。与简单降采样不同,GCG通过新颖的全局-局部帧交换机制构建,该机制将稀疏全局关键帧与局部时间窗口耦合,并在采样过程中实现信息交换,使得GCG能够将长期结构一致性与短期动态变化编码至统一表征中。在该表征引导下,HL-OutPaint随后执行高分辨率外扩,生成空间细节丰富且时间连贯的内容。通过将全局结构建模与精细合成相分离,本框架能够针对大范围空间扩展与长视频序列实现稳定连贯的生成。大量实验表明,在涉及宽空间外推与长视频序列的挑战性场景中,HL-OutPaint的性能优于现有方法。