Reproduce “The Optimal Rate Constant of Heavy-Ball Momentum on Smooth Strongly Convex Functions” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Marcos Hernanz

The authors determine the best worst-case distance contraction rate of constant-parameter heavy-ball momentum on smooth strongly convex functions in dimensions at least two. They prove a two-dimensional spiral construction limits every tuning, and give a Lyapunov certificate for an explicit tuning. For condition number κ at least 400, the leading constant is 8, versus 2 for gradient descent; this is an exact-gradient iteration result, not a time guarantee.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.