Self-Improving Video-to-Action Models↗ (원문, 새 창)

본문 미리보기

arXiv:2610.24177v1 Announce Type: new Abstract: Video generative models are an emerging tool for embodied agents: they can serve as scalable visual planners, generating videos that depict how to complete previously unseen tasks. However, executing these plans typically requires a video-to-action or "inverse dynamics" model trained on large, human-collected video-action datasets, severely limiting scalability. We introduce Mirror, a self-supervised approach that learns video-to-action mappings t