Reproduce “How to Scale Mixture-of-Experts: From muP to the Maximally Scale-Stable Parameterization” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.