Reproduce “Ask More, Hear Less: How a Review Prompt Changes What Online Ratings Show” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Zihan Chen, Lei Nico Zheng, Di Zhu
The authors study how Steam’s October 2019 review prompt affected ratings’ ability to track game changes and fixed labels’ responses. Using 21.6 million reviews of 315 games and adjacent playtime groups around an inferred three-hour eligibility threshold, they find reduced score pass-through but no detectable threshold-specific sensitivity loss at natural review counts; fixed-tier hit-rate evidence is imprecise.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.