Reproduce “The Nature of NLP: Analyzing Contributions in NLP Papers” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Aniket Pramanick, Yufang Hou, Saif M. Mohammad, Iryna Gurevych
This research quantitatively analyzes the stated contributions in NLP papers over five decades, introducing a taxonomy for contribution types and creating a large annotated dataset. The study reveals shifts in NLP's focus from linguistic foundations to method/artifact development, alongside a recent resurgence in language- and human-centric contributions.
Key insights
- A structured taxonomy effectively captures the diverse and evolving nature of contributions within the NLP field.
- Analyzing explicitly stated contribution statements in papers provides a granular, data-driven understanding of research trends and disciplinary shifts, complementing traditional bibliometric methods.
- The emphasis on different types of contributions, such as new datasets or methods versus knowledge about language or people, directly influences a paper's citation impact within the community.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.