Reproduce “EvoAgent: Towards Automatic Multi-Agent Generation via Evolutionary Algorithms” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Siyu Yuan, Kaitao Song, Jiangjie Chen, Xu Tan, Dongsheng Li, Deqing Yang

EVOAGENT introduces an evolutionary algorithm-inspired method for automatically generating specialized multi-agent systems from existing LLM-based agents, enhancing their task-solving capabilities. This approach consistently improved performance across diverse benchmarks, including achieving 77.00% on Logic Grid Puzzle and higher constraint adherence in complex real-world planning tasks like TravelPlanner, compared to human-designed and other automated baselines.

Key insights

  • Evolutionary algorithms, when facilitated by LLMs, provide an effective paradigm for automatically generating and optimizing diverse multi-agent systems from existing specialized agents.
  • Automating the agent generation process addresses the limitations of human-designed frameworks, enhancing scalability, functional scope, and adaptability of LLM-based agents.
  • Automatically generated specialized agents, through their collaborative intelligence, lead to superior task-solving capabilities across various domains compared to single agents or less specialized multi-agent setups.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.