Reproduce “LLM-Generated Investment Research Memos Need Validation” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Xukang Gong, Chenri Luo, Binyan Yu, Xiao-Yang Liu
The paper checks investment memos by extracting factual claims and comparing them with official company-period materials used to generate each memo. It labels direct contradictions as refuted and flags any memo containing one as contaminated. Across four agent configurations, claim-refutation rates were 1.17% to 1.77%, while contamination rates were 36.94% to 41.11%; labels reflect the source bundle, not objective truth.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.