Reproduce “Lost in the Hallway: Benchmarking Persistent Spatial Memory Across Revisits” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Henry Zheng, Weibo Gong, Yang Yue, Rui Huang, Yang Zhang, Gao Huang
ReSpaceBench evaluates whether embodied agents can recognize physical rooms across visits, distinguish same-type rooms, and track changing contents. It defines visits by physical entry and tests room association, state, and route reasoning using routes with revisits and lookalike rooms. On a shared 450-question subset, humans averaged 90.1% accuracy and GPT-5.6 Sol scored 52.2%; unrestricted human viewing limits this comparison.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.