Reproduce “MFSA: A Multi-Format Systolic Array with Native Micro Scaling Support” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Jiayi Wang, Kearnan Bishop, Ang Li
MFSA uses a shared dot-product processing element in a weight-stationary systolic array and Online Block-Scale Rebasing (OBSR) for microscaled blocks. OBSR adjusts the FP32 partial-sum exponent at block boundaries, avoiding a second accumulation path. Its FP4 PE is 4.5× smaller than a matched FMA baseline; on measured LLM traces, OBSR agreed closely with naive support, but adversarial inputs triggered clamps.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.