Reproduce “Can You Trust Your Finance Agent? Drift, Diagnosis and Auditable Intervention on One Shipped Financial Research Agent” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Cosimo Galeone, Anna Ettorre, Ginevra Mariani, Minsu Park, Giuseppe Ettorre, Daniele Ligorio
The authors evaluate an auditable process for a financial research agent by repeating runs, inspecting traces, and testing changes against baselines on held-out questions. The cost-focused configuration reduced test cost to 0.341 of baseline, with a 95% confidence interval below the prespecified noise threshold; the accuracy gain was inconclusive. Evidence covers one agent and nine questions.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.