Reproduce “What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.