Reproduce “Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.