Reproduce “UniState: Unifying Memory and Intervention for Controllable World Simulation” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Jaeseok Jeong, Kyungmook Choi, Sohyun Chung, Youngsik Yun, Youngjung Uh

UniState lets users specify object motion and camera paths separately within a shared 3D state. It lifts images into spatial memory, applies object interventions, and uses a video model to generate unspecified responses. Across 277 scenarios, it records a World-Control Projection Error of 2.323%, versus 2.425% for MotionCanvas; this 2D proxy does not verify 3D motion or physical interaction.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.