Reproduce “Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.