Reproduce “Cognitive Models and AI Algorithms Provide Templates for Designing Language Agents” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Ryan Liu, Dilip Arumugam, Cedegao E. Zhang, Sean Escola, Xaq Pitkow, Thomas L. Griffiths

The authors propose agent templates that organize language models and tools into workflows based on cognitive models and AI algorithms. Each template is an acyclic graph whose nodes perform functions and whose edges direct information and execution. In a preliminary numerical Wordle-like task, an IDS agent came closer to the Bayes-optimal policy than PSRL, a result limited to one domain.

Key insights

  • Established cognitive models offer proven blueprints for designing robust and interpretable communication, reasoning, and planning modules within language agents.
  • Classical AI algorithms provide structured, time-tested approaches for decomposing and solving complex problems with LLMs, leading to more principled agent designs.
  • Leveraging these templates enhances agent interpretability, accelerates development by providing pre-validated strategies, and consistently improves performance across diverse tasks.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.