Reproduce “ReAnchor: Reusing Rejected Verifier States for Diffusion Drafting” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Sanghyun Lee, Wonjin Nam, Seungho Jang, Jaeho Lee, Jiho Park, Jaewoon Lee, Seungryong Kim
ReAnchor improves speculative decoding with block-diffusion drafters by reusing verifier hidden states from rejected suffixes as conditioning for additional native-length draft blocks. It matches their starting tokens to the baseline draft and has the target verify every continuation. At temperature T=0, it raises acceptance length 15.2% and speed 13.4% across four models and eight benchmarks, though gains vary by setting.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.