Long-horizon manipulation with a language-planned world-action model专业
Jiajun Cao, Kai Tang, Bohua Zhang, Zezhong Qian, Ying Li, Xiaozhu Ju, Xiaobao Wei, Jiaming Liu, Yang Ding, Sixiang Chen, Yiding Sun, Siyuan Qian, Tinghao Wang, Jixian Wu, Yichen Guo, Yi Zhang, Shilong Zou, Yong Dai, Jian Tang, Shanghang ZhangState Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University; Beijing Innovation Center of Humanoid Robotics
据预印本论文,北京大学与北京人形机器人创新中心提出的机器人控制系统LAW,在真实双臂机器人上完成三项多步骤长程任务的平均成功率为65%,对比Physical Intelligence的pi0.5为28.33%,世界动作模型Fast-WAM为25%。系统由一个20亿参数的小型视觉语言模型负责规划和判断进度,引导一个同时预测动作与未来画面的模型。