Physics-based optical flow models have been successful in capturing the deformities in fluid motion arising from digital imagery. However, a common theoretical framework analyzing several physics-based models is missing. In this regard, we formulate a general framework for fluid motion estimation using a constraint-based refinement approach. We demonstrate that for a particular choice of constraint, our results closely approximate the classical continuity equation-based method for fluid flow. This closeness is theoretically justified by augmented Lagrangian method in a novel way. The convergence of Uzawa iterates is shown using a modified bounded constraint algorithm. The mathematical wellposedness is studied in a Hilbert space setting. Further, we observe a surprising connection to the Cauchy-Riemann operator that diagonalizes the system leading to a diffusive phenomenon involving the divergence and the curl of the flow. Several numerical experiments are performed and the results are shown on different datasets. Additionally, we demonstrate that a flow-driven refinement process involving the curl of the flow outperforms the classical physics-based optical flow method without any additional assumptions on the image data.
翻译:基于物理的光流模型在捕获数字图像中流体运动产生的形变方面取得了成功。然而,目前缺乏一个分析多种基于物理模型的通用理论框架。为此,我们提出了一种采用基于约束的精细化方法的通用流体运动估计框架。我们证明,对于特定的约束选择,我们的结果能够较好地逼近基于经典连续性方程的流体流动方法。这一近似性通过增广拉格朗日方法在理论上得到了新颖的论证。我们采用改进的有界约束算法展示了Uzawa迭代的收敛性。在希尔伯特空间框架下研究了数学适定性。此外,我们观察到与柯西-黎曼算子间存在令人意外的联系,该算子将系统对角化,从而引发涉及流动散度和旋度的扩散现象。我们进行了多项数值实验,并在不同数据集上展示了结果。进一步地,我们证明:一种涉及流动旋度的流驱动精细化方法,在对图像数据不作任何额外假设的前提下,其性能优于经典的基于物理的光流方法。