Reproduce “Training Specialist LLMs on Your Phone: Forward-Only Optimization via Block-Spectral Coordinates” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Liyan Tan, Yequan Zhao, Ziyue Liu, Yupeng Su, Ruijie Zhang, Zheng Zhang
MobileSpec trains task-specific specialists for shared language models using forward-only evolution strategies rather than backpropagation. FuRA-S adjusts singular values of column blocks, enabling small specialist files while leaving quantized weights unchanged. On RequestCarpooling, success rose from 6.2% to 98.4% with step-wise fitness, versus 14.1% with episode rewards. This is one of five phone tasks and requires a usable fitness signal.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.