Reproduce “Stay Within Your Bounds: Distance-Guided Decoding for Guaranteed Context-Free Grammar Compliance” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Vincenzo Collura, Karim Tit, Eleonora Giunchiglia, Mike Papadakis, Maxime Cordy
SWYB guides grammar-constrained generation toward acceptance by tracking a pushdown automaton state, estimating the token cost of a known accepting route, and pruning continuations that exceed the remaining budget. On JSON tasks, it achieves 100% syntax and schema validity across three models; for Llama-3.2-3B-Instruct, Outlines reaches 90.0% schema validity. The guarantee is syntactic, bounded, and not semantic or search-complete.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.