What if a world simulation model could render not an imagined environment but a city that actually exists? Prior generative world models synthesize visually plausible yet artificial environments by imagining all content. We present Seoul World Model (SWM), a city-scale world model grounded in the real city of Seoul. SWM anchors autoregressive video generation through retrieval-augmented conditioning on nearby street-view images. However, this design introduces several challenges, including temporal misalignment between retrieved references and the dynamic target scene, limited trajectory diversity and data sparsity from vehicle-mounted captures at sparse intervals. We address these challenges through cross-temporal pairing, a large-scale synthetic dataset enabling diverse camera trajectories, and a view interpolation pipeline that synthesizes coherent training videos from sparse street-view images. We further introduce a Virtual Lookahead Sink to stabilize long-horizon generation by continuously re-grounding each chunk to a retrieved image at a future location. We evaluate SWM against recent video world models across three cities: Seoul, Busan, and Ann Arbor. SWM outperforms existing methods in generating spatially faithful, temporally consistent, long-horizon videos grounded in actual urban environments over trajectories reaching hundreds of meters, while supporting diverse camera movements and text-prompted scenario variations.
翻译:如果世界仿真模型能够渲染的不是虚构环境,而是真实存在的城市,将会如何?现有的生成式世界模型通过想象所有内容来合成视觉上合理但人工构造的环境。本文提出首尔世界模型(SWM),这是一个以真实首尔市为基础构建的城市尺度世界模型。SWM通过检索增强的邻近街景图像条件化机制,为自回归视频生成提供空间锚点。然而,这种设计带来了若干挑战:包括检索参考帧与动态目标场景之间的时序错位、车载间隔采集导致的轨迹多样性受限及数据稀疏性问题。我们通过跨时序配对技术、支持多样化相机轨迹的大规模合成数据集,以及从稀疏街景图像生成连贯训练视频的视角插值流程来解决这些挑战。进一步引入虚拟前瞻汇点机制,通过将每个生成片段持续重锚定至未来位置的检索图像,从而稳定长时程生成过程。我们在首尔、釜山和安娜堡三个城市中,将SWM与近期视频世界模型进行对比评估。SWM在生成空间保真、时序连贯、基于真实城市环境的长时程视频(轨迹长度达数百米)方面优于现有方法,同时支持多样化的相机运动与文本提示的场景变体。