Reproduce “ASAP: Asynchronous Approximate Data-Parallel Computation” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Asim Kadav, Erik Kruus

ASAP reduces communication in distributed learning by having workers exchange updates with selected peers, not all workers. Its NOTIFY-ACK protocol makes senders wait until peers consume updates. In a 25-process webspam SVM test using a root-expander graph, NOTIFY-ACK converged about three times faster than BSP, while ASYNC did not reach the correct value despite higher throughput; this finding is limited to that setup.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.