Look Before You Move: Agent-Interface-Aligned Supervision for Open-World Mobile Manipulation
From the abstract
Open-world mobile manipulation requires a robot to find an object, approach it, and move it to a target receptacle from a language instruction. Training vision-language model (VLM) agents for these tasks requires demonstrations of both action selection and active vision.
From the abstract. Our summary is in progress.