Reproduce “"LazImpa": Lazy and Impatient neural agents learn to communicate efficiently” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Mathieu Rita, Rahma Chaabouni, Emmanuel Dupoux

The "LazImpa" framework enables neural agents to develop efficient communication codes that adhere to Zipf's Law of Abbreviation, where frequent messages are shorter. It achieves human-like message length efficiency and information front-loading by integrating a 'Lazy Speaker' (with adaptive length penalty) and an 'Impatient Listener' (making intermediate predictions), overcoming prior observed inefficiencies in emergent communication.

Key insights

  • Efficient, ZLA-obeying communication is an emergent property requiring coordinated constraints on both the speaker and the listener agents.
  • The Impatient Listener's demand for early information placement enables the Lazy Speaker to effectively reduce message length without compromising communication accuracy.
  • Incorporating cognitively plausible biases (laziness and impatience) can guide artificial communication systems towards human-like linguistic properties.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.