This paper introduces SENA (SEamlessly NAtural), a geometry-driven image stitching approach that prioritizes structural fidelity in challenging real-world scenes characterized by parallax and depth variation. Conventional image stitching relies on homographic alignment, but this rigid planar assumption often fails in dual-camera setups with significant scene depth, leading to distortions such as visible warps and spherical bulging. SENA addresses these fundamental limitations through three key contributions. First, we propose a hierarchical affine-based warping strategy, combining global affine initialization with local affine refinement and smooth free-form deformation. This design preserves local shape, parallelism, and aspect ratios, thereby avoiding the hallucinated structural distortions commonly introduced by homography-based models. Second, we introduce a geometry-driven adequate zone detection mechanism that identifies parallax-minimized regions directly from the disparity consistency of RANSAC-filtered feature correspondences, without relying on semantic segmentation. Third, building upon this adequate zone, we perform anchor-based seamline cutting and segmentation, enforcing a one-to-one geometric correspondence across image pairs by construction, which effectively eliminates ghosting, duplication, and smearing artifacts in the final panorama. Extensive experiments conducted on challenging datasets demonstrate that SENA achieves alignment accuracy comparable to leading homography-based methods, while significantly outperforming them in critical visual metrics such as shape preservation, texture integrity, and overall visual realism.
翻译:本文提出SENA(无缝自然)方法,一种几何驱动的图像拼接方法,在具有视差和深度变化的复杂真实场景中优先保持结构保真度。传统图像拼接依赖于单应性对齐,但这种刚性的平面假设在具有显著场景深度的双摄像头设置中往往失效,导致可见扭曲和球状膨胀等失真。SENA通过三个关键创新解决这些根本性局限。首先,我们提出基于层次化仿射的变形策略,将全局仿射初始化与局部仿射细化及平滑自由形变相结合。该设计能保持局部形状、平行性和纵横比,从而避免基于单应性模型常产生的虚假结构失真。其次,我们引入几何驱动的适切区域检测机制,直接从RANSAC过滤后的特征对应点的视差一致性中识别视差最小化区域,无需依赖语义分割。第三,基于该适切区域,我们执行锚点驱动的接缝切割与分割,通过构造强制实现图像对间的一对一几何对应,从而有效消除最终全景图中的重影、重复和模糊伪影。在具有挑战性的数据集上进行的大量实验表明,SENA在配准精度上达到与主流单应性方法相当的水平,同时在形状保持、纹理完整性和整体视觉真实感等关键视觉指标上显著优于现有方法。