We introduce altiro3D, a free extended library developed to represent reality starting from a given original RGB image or flat video. It allows to generate a light-field (or Native) image or video and get a realistic 3D experience. To synthesize N-number of virtual images and add them sequentially into a Quilt collage, we apply MiDaS models for the monocular depth estimation, simple OpenCV and Telea inpainting techniques to map all pixels, and implement a 'Fast' algorithm to handle 3D projection camera and scene transformations along N-viewpoints. We use the degree of depth to move proportionally the pixels, assuming the original image to be at the center of all the viewpoints. altiro3D can also be used with DIBR algorithm to compute intermediate snapshots from a equivalent 'Real (slower)' camera with N-geometric viewpoints, which requires to calibrate a priori several intrinsic and extrinsic camera parameters. We adopt a pixel- and device-based Lookup Table to optimize computing time. The multiple viewpoints and video generated from a single image or frame can be displayed in a free-view LCD display.
翻译:我们介绍了altiro3D,这是一个免费扩展库,旨在从给定的原始RGB图像或平面视频出发,实现对现实世界的表示。它能生成光场(或原生)图像或视频,并提供逼真的3D体验。为合成N个虚拟图像并将其依次拼接成拼贴画,我们采用MiDaS模型进行单目深度估计,利用简单的OpenCV和Telea修复技术映射所有像素,并实现了一种“快速”算法,用于处理沿N个视点的3D投影相机和场景变换。我们利用深度值按比例移动像素,假设原始图像位于所有视点的中心。altiro3D也可与DIBR算法结合使用,从等效的具有N个几何视点的“真实(较慢)”相机计算中间快照,这需要预先标定多个相机内外参数。我们采用基于像素和设备的查找表来优化计算时间。从单张图像或帧生成的多个视点及视频可在自由视角LCD显示器上显示。