robot foundation model trainingExpert
Multi-Teacher On-Policy Distillation for Flow-Based Vision-Language-Action Models
Huawei researchers show how to merge several specialist robot-control models into one generalist by letting the generalist practise and having the specialists correct it at every step of its action generation. In three simulation benchmarks the merged model gained 22 to 33 points of success over a standard fine-tune, though it still trails the specialists.