Scene-level neural volumetric reconstruction from monocular videos remains challenging, especially under severe domain shifts. Although recent advances in vision foundation models (VFMs) provide transferable generalized priors learned from large-scale data, their scale-ambiguous predictions are incompatible with the scale consistency required by volumetric fusion. To address this gap, we present VFM-Recon, the first attempt to bridge transferable VFM priors with scale-consistent requirements in scene-level neural reconstruction. Specifically, we first introduce a lightweight scale alignment stage that restores multi-view scale coherence. We then integrate pretrained VFM features into the neural volumetric reconstruction pipeline via lightweight task-specific adapters, which are trained for reconstruction while preserving the cross-domain robustness of pretrained representations. We train our model on ScanNet train split and evaluate on both in-distribution ScanNet test split and out-of-distribution TUM RGBD and Tanks and Temples datasets. The results demonstrate that our model achieves state-of-the-art performance across all dataset domains. In particular, on the challenging outdoor Tanks and Temples dataset, our model achieves an F1 score of 73.5 in reconstructed mesh evaluation, substantially outperforming the closest neural volumetric reconstruction competitor, SimpleRecon, with an F1 score of 35.7, as well as the closest VFM competitor, $π^3$, with an F1 score of 67.0.
翻译:暂无翻译