As an important and practical way to obtain high dynamic range (HDR) video, HDR video reconstruction from sequences with alternating exposures is still less explored, mainly due to the lack of large-scale real-world datasets. Existing methods are mostly trained on synthetic datasets, which perform poorly in real scenes. In this work, to facilitate the development of real-world HDR video reconstruction, we present Real-HDRV, a large-scale real-world benchmark dataset for HDR video reconstruction, featuring various scenes, diverse motion patterns, and high-quality labels. Specifically, our dataset contains 500 LDRs-HDRs video pairs, comprising about 28,000 LDR frames and 4,000 HDR labels, covering daytime, nighttime, indoor, and outdoor scenes. To our best knowledge, our dataset is the largest real-world HDR video reconstruction dataset. Correspondingly, we propose an end-to-end network for HDR video reconstruction, where a novel two-stage strategy is designed to perform alignment sequentially. Specifically, the first stage performs global alignment with the adaptively estimated global offsets, reducing the difficulty of subsequent alignment. The second stage implicitly performs local alignment in a coarse-to-fine manner at the feature level using the adaptive separable convolution. Extensive experiments demonstrate that: (1) models trained on our dataset can achieve better performance on real scenes than those trained on synthetic datasets; (2) our method outperforms previous state-of-the-art methods. Our dataset is available at https://github.com/yungsyu99/Real-HDRV.

翻译：作为获取高动态范围（HDR）视频的重要实用途径，基于交替曝光序列的HDR视频重建仍鲜有深入研究，主要受限于缺乏大规模真实世界数据集。现有方法大多在合成数据集上训练，难以在真实场景中取得理想效果。为促进真实场景HDR视频重建的发展，本文提出Real-HDRV——一个面向HDR视频重建的大规模真实世界基准数据集，涵盖多样化场景、丰富运动模式及高质量标签。具体而言，本数据集包含500组LDR-HDR视频对，共计约28,000帧LDR图像与4,000帧HDR标签，覆盖日间、夜间、室内及室外场景。据我们所知，这是当前规模最大的真实世界HDR视频重建数据集。同时，我们提出一种端到端HDR视频重建网络，创新性地设计了两阶段顺序对齐策略：第一阶段通过自适应估计全局偏移实现全局对齐，降低后续对齐难度；第二阶段采用自适应可分离卷积，在特征层面以从粗到细的方式隐式完成局部对齐。大量实验表明：（1）基于本数据集训练的模型在真实场景中的表现显著优于合成数据集训练模型；（2）本方法性能超越现有最优方法。数据集开源地址：https://github.com/yungsyu99/Real-HDRV。