Reproduce “Position: The AI Conference Peer Review Crisis Demands Author Feedback and Reviewer Rewards” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Jaeho Kim, Yunseok Lee, Seulki Lee
Researchers from UNIST address the escalating challenges within the peer review process of major AI conferences by proposing a bi-directional feedback loop where authors evaluate review quality. The paper also outlines a systematic reviewer reward framework, aiming to improve review quality and reviewer accountability amidst the rapid growth in paper submissions.
Key insights
- The inherent power imbalance in the current one-way review system leads to reviewer negligence due to a lack of accountability.
- The traditional voluntary service model is insufficient for the exponential growth in submissions, resulting in reviewer exploitation and demotivation for high-quality reviews.
- Implementing bi-directional feedback and systematic rewards is essential to professionalize peer review, enhance accountability, and ensure the long-term sustainability and quality of AI conferences.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.