Reproduce “LLM-Generated Investment Research Memos Need Validation” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Xukang Gong, Chenri Luo, Binyan Yu, Xiao-Yang Liu

The paper checks investment memos by extracting factual claims and comparing them with official company-period materials used to generate each memo. It labels direct contradictions as refuted and flags any memo containing one as contaminated. Across four agent configurations, claim-refutation rates were 1.17% to 1.77%, while contamination rates were 36.94% to 41.11%; labels reflect the source bundle, not objective truth.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.