Reproduce “Beyond the Sink Interpretation: Radial Attention in Flow-Based VLA Policies” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Yuxi Zheng, Yueqian Lin, Yudong Liu, Zijia Tang, Junyu Pan, Yiheng Wang, Hai Helen Li, Yiran Chen

Paper tests whether attention at action-chunk endpoints marks inert sinks. It shifts positional rotations with query/key content fixed, and edits values. Endpoint values have near-average norms and above-average gated contributions. In paired RoboCasa episodes, endpoint replacement changed success by −3.6 points, versus −28.4 for executed interior tokens; this comparison confounds position with execution and covers one checkpoint, not adaptive replanning.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.