Reproduce “From Video to Digital Twin: An Exploratory Study of World Models and Gaussian Splatting on In-the-Wild Video” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Somesh Mohapatra

The authors turn 20 selected images from a public warehouse tour into a partial digital twin, using a commercial world model to estimate camera poses and metric depth and fusing results into Gaussian splats. Local training achieved 21.16 dB with 64 frames versus 17.34 dB with 8; attempts to generate missing views failed, so unseen space remains unverified.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.