Action-supervised fine-tuning of vision-language-action (VLA) policies can compress visual structure that is weakly constrained by the action objective. We formalize this as residual visual collapse along local action fibers and propose FiberTune, a training-time objective that preserves teacher-structured visual residuals without adding inference-time overhead. FiberTune uses an online action probe to filter action-predictive directions from intermediate visual-token representations. It preserves the residuals through centered directional alignment with a frozen visual teacher and effective-rank regularization. Under identical training conditions, FiberTune improves over task-loss-only fine-tuning in every one of six simulation settings spanning two benchmarks and two architectures ($π_{0.5}$ and OpenVLA-OFT), as well as on physical SO-101 pick-and-place; representative gains include +10.7 pp SR(5) on long-horizon CALVIN ABC$\rightarrow$D and physical SO-101 task success rising from 72.7% to 78.1%. Representation analyses support the preservation of visual information in the residuals.
翻译:暂无翻译