Video acquired from multiple cameras located along a line is often rectified to video virtually obtained from cameras with ideally parallel optical axes collocated on a single plane and principal points on a line. Such an approach simplifies video processing including depth estimation and compression. Nowadays, for many application video, like virtual reality or virtual navigation, the content is often acquired by cameras located nearly on a circle or on a part of that. Therefore, we introduce new operation of circular rectification that results in multiview video virtually obtained from cameras located on an ideal arc and with optical axes that are collocated on a single plane and they intersect in a single point. For the circularly rectified video, depth estimation and compression are simplified. The standard 3DHEVC codec was designed for rectified video and its efficiency is limited for video acquired from cameras located on an arc. Therefore, we developed a 3-D HEVC codec modified in order to compress efficiently circularly rectified video. The experiments demonstrate its better performance than for the standard 3D-HEVC codec.
翻译:沿直线排列的多摄像头采集的视频通常被校正为理想状态下光轴平行、共面且主点共线的虚拟摄像头视频。该方法可简化深度估计与压缩等视频处理流程。当前,虚拟现实或虚拟导航等应用场景中,视频内容常由近似圆形或圆弧排列的摄像头采集。为此,我们提出新型圆形校正操作,可将多视点视频校正为理想状态下摄像头位于圆弧上、光轴共面且交于同一点的虚拟视频。经圆形校正的视频可简化深度估计与压缩处理。标准3D-HEVC编解码器专为校正视频设计,对圆弧排列摄像头采集的视频压缩效率有限。因此,我们开发了改进型3D-HEVC编解码器,可高效压缩圆形校正视频。实验证明,该编解码器性能优于标准3D-HEVC编解码器。