The recently developed Sora model [1] has exhibited remarkable capabilities in video generation, sparking intense discussions regarding its ability to simulate real-world phenomena. Despite its growing popularity, there is a lack of established metrics to evaluate its fidelity to real-world physics quantitatively. In this paper, we introduce a new benchmark that assesses the quality of the generated videos based on their adherence to real-world physics principles. We employ a method that transforms the generated videos into 3D models, leveraging the premise that the accuracy of 3D reconstruction is heavily contingent on the video quality. From the perspective of 3D reconstruction, we use the fidelity of the geometric constraints satisfied by the constructed 3D models as a proxy to gauge the extent to which the generated videos conform to real-world physics rules. Project page: https://sora-geometrical-consistency.github.io/

翻译：近期开发的Sora模型[1]在视频生成领域展现出卓越能力，引发了关于其模拟现实世界现象能力的激烈讨论。尽管该模型日益普及，但目前缺乏定量评估其与现实物理世界一致性的既定指标。本文提出了一项新的基准测试，通过衡量生成视频是否符合现实物理原理来评估其质量。我们采用一种将生成视频转化为三维模型的方法，其核心前提是三维重建的精度高度依赖于视频质量。从三维重建的视角出发，我们将构建的三维模型所满足几何约束的保真度作为代理指标，以评估生成视频遵循现实世界物理规则的程度。项目页面：https://sora-geometrical-consistency.github.io/