Reproduce “NeoWorld-3: From Pixels to Code-Defined Physical Worlds” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Eachen Soong, Zijian Niu, Haoran Xu, Yihong Dong, Yunbo Wang, Xiaokang Yang

NeoWorld-3 reconstructs editable simulation worlds from observations, combining agent-led code construction with visual fitting and checks of geometry and motion. In 10 RoboCasa365 scenes, its full tooling package achieved DINOv3 similarity of 0.8142 and a 0.67% part-penetration rate, versus 0.7644 and 45.41% with BlenderMCP. This bundled comparison does not isolate components or establish complete physical validity.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.