Beyond the Sink Interpretation: Radial Attention in Flow-Based VLA Policies
From the abstract
Prior work calls the high attention on the first and last action tokens of a flow-based VLA policy a radial action sink, and uses these tokens to set the execution horizon. In language models, a sink is a token with high incoming attention, a small value, and little effect on the output.
From the abstract. Our summary is in progress.
The full text is not republished here because the paper's license does not allow it. Read the original on arXiv.