Reproduce “FP64 Is All You Want, INT8 Is All You Need, FP4/6/8 Is All You Have” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Pratyai Mazumder, Alexandru Calotoiu, Torsten Hoefler

The authors develop a search method for Ozaki II schemes that use low-precision matrix multiplications to reproduce integer-valued matrix products. It jointly selects pairwise-coprime moduli and a multiplication form for each modulus. On B300, its E2M1 FP4 scheme runs 83× faster than native FP64 for tested square GEMM at n = 2¹⁵ = 32,768; this is setup-specific, and the search is exact only over its candidate forms.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.