Reproduce “Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.