VLA ConditioningIntermediate
Continuous Conditioning of VLAs with Augmenting EMG and Visual Task Descriptors
This preprint tunes action-expert vision-language-action models to accept non-language task cues: 8-channel EMG envelopes or visual segmentation annotations. On a real cube-picking task, EMG conditioning lifts cluttered success from 30% to 50% and cuts failure rate from 50% to 4%; on 16 simulated RoboCasa pick-and-place tasks, visual annotations lift cluttered success from 11% to 20% and cut failure from 47% to 25%. The findings suggest downstream VLA policies can usefully condition on continuous cues beyond fixed language prompts, especially in clutter.