Reproduce “An equality condition for the Dobrushin bound on attention rollout and how often it holds in trained transformers” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.