Reproduce “Epistemic Robustness of Large Language Models Under Interaction: Sycophancy, Persuasion, Deception, and Belief Drift” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Yubo Li, Ramayya Krishnan, Rema Padman

The authors review how conversational models should be evaluated for warranted revision. They distinguish concession—abandoning correct answers without grounds—from failed correction when adequate support is available. Across 58 conditions from 12 studies, every model-side intervention reducing concession raised revision criterion; 10 of 19 changed sensitivity by less than 0.4. These re-expressed findings are not a pooled causal estimate.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.