Reproduce “You can just review things: A digital ethnography of informal peer review” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Jay Patel, Joel Chan

Through a digital ethnography across diverse online platforms, researchers at the University of Maryland – College College investigated informal peer review, characterizing its participants, platforms, evaluation methods, and impacts. The study proposes a new conceptual definition and the "patchwork evidence infrastructure" theory, offering practical recommendations for enhancing this form of scholarly evaluation.

Key insights

  • Informal peer review is conceptually defined as the inclusive evaluation of research on publisher-independent platforms, involving direct interactions and often leading to tangible revisions.
  • The practice operates as a "patchwork evidence infrastructure," a fragmented and self-organized assemblage of diverse reviewers, communities, and technologies for public research evaluation.
  • This infrastructure primarily serves as a quality control mechanism, embodying Robert Merton's norms of science through its stateless anarchy and emergent communal norms.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.