Reproduce “The Rotary Position Embedding May Cause Dimension Inefficiency in Attention Heads for Long-Distance Retrieval” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.