Video colorization, aiming at obtaining colorful and plausible results from grayish frames, has aroused a lot of interest recently. Nevertheless, how to maintain temporal consistency while keeping the quality of colorized results remains challenging. To tackle the above problems, we present a Histogram-guided Video Colorization with Spatial-Temporal connection structure (named ST-HVC). To fully exploit the chroma and motion information, the joint flow and histogram module is tailored to integrate the histogram and flow features. To manage the blurred and artifact, we design a combination scheme attending to temporal detail and flow feature combination. We further recombine the histogram, flow and sharpness features via a U-shape network. Extensive comparisons are conducted with several state-of-the-art image and video-based methods, demonstrating that the developed method achieves excellent performance both quantitatively and qualitatively in two video datasets.
翻译:摘要:视频着色旨在从灰度帧中生成色彩丰富且视觉真实的结果,近年来引起了广泛关注。然而,如何在保持着色质量的同时维持时间一致性仍是一大挑战。为解决上述问题,本文提出一种基于直方图引导的时空连接结构视频着色方法(命名为ST-HVC)。为充分利用色度与运动信息,我们设计了联合光流与直方图模块,用于整合直方图特征与光流特征。针对模糊与伪影问题,我们提出了一种融合方案,兼顾时序细节与光流特征的组合。进一步地,通过U型网络对直方图、光流及锐度特征进行重组。与多种基于图像与视频的先进方法进行广泛对比表明,所提方法在两个视频数据集上均取得了定量与定性上的优越性能。