Reproduce “RouteVerify: Routing Interventions for Step-Level Verification in Mixture-of-Experts Models” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Yucheng Du, Ryan A. Rossi, Xiyang Hu
RouteVerify tests whether internal routing signals guide step-level verification by replacing selected activations from another trace while keeping evaluated text unchanged. It tests score shifts and dependence on donor correctness. Router states reveal correctness, and all-layer routing shifts scores across nine checkpoints, but fixed-receiver donor-correctness effects are positive in only one. These findings apply to the tested checkpoints.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.