Reproduce “A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.