Reproduce “Shepherd: Enabling Programmable Meta-Agents via Reversible Agentic Execution Traces” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Simon Yu, Derek Chong, Ananjan Nandi, Dilara Soylu, Jiuding Sun, Christopher D Manning, Weiyan Shi

SHEPHERD is a Python substrate that enables programmable meta-agents by reifying agentic execution as a first-class object, allowing for efficient observation, manipulation, and reversion of agent and environment states. This framework enhances multi-agent coordination, workflow optimization, and reinforcement learning by providing granular control over execution traces.

Key insights

  • Reifying agentic execution as a first-class object allows meta-agents to directly inspect, transform, and manipulate agent behavior at runtime or post-hoc, analogous to functions in functional programming.
  • Immutable effect streams provide a non-perturbing mechanism for meta-agents to observe agent actions and intervene between an action's intent and its outcome.
  • Efficient copy-on-write forking of agent-environment states and a persistent, Git-like execution trace enable fast counterfactual exploration, precise rollback to any past state, and granular control over execution history.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.