MEKAWIRE
ExpertarXiv

Beyond the Sink Interpretation: Radial Attention in Flow-Based VLA Policies

Yuxi Zheng, Yueqian Lin, Yudong Liu, Zijia Tang, Junyu Pan, Yiheng Wang, Hai Helen Li, Yiran Chen
From the abstract

Prior work calls the high attention on the first and last action tokens of a flow-based VLA policy a radial action sink, and uses these tokens to set the execution horizon. In language models, a sink is a token with high incoming attention, a small value, and little effect on the output.

From the abstract. Our summary is in progress.

The full text is not republished here because the paper's license does not allow it. Read the original on arXiv.