Reproduce “Visual Theory of Mind Enables the Invention of Proto-Writing” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Benjamin A. Spiegel, Lucas Gelfond, George Konidaris

Researchers at Brown University developed a computational model for the emergence of proto-writing, demonstrating that a "visual theory of mind" in agents enables the invention of iconic pictographs and bridges "signification gaps" for complex referents. Their "Signification Game" environment shows this capacity is crucial for explaining the uniqueness of human writing and its evolution from iconic to abstract forms.

Key insights

  • A "visual theory of mind," enabling agents to reason about others' visual perception and drawing abilities, is critical for the invention of iconic proto-writing.
  • "Signification gaps," which are the inherent difficulties in visually representing complex referents with limited tools, pose a fundamental barrier that inferential communication can overcome.
  • The evolution from iconic pictographs to abstract symbols is a continuous process driven by communicative efficiency and cooperative pressures.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.