Reproduce “DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Miaowei Wang, Yibo Zhang, Rui Ma, Weiwei Xu, Changqing Zou, Daniel Morris
DecoupledGaussian introduces a system that translates real-world video captures into interactive 3D environments, enabling objects to realistically detach and interact with scene surfaces through physics-based simulations. It achieves this by accurately restoring the fragmented 3D geometry and texture of objects and scenes after separation.
Key insights
- Accurate 3D geometry restoration of occluded parts is crucial for enabling realistic object detachment and unconstrained physics-based interactions in captured scenes.
- Leveraging geometric priors and a joint reconstruction approach, like joint Poisson fields with proxy points, effectively addresses the fragmented data challenges from 'in-the-wild' captures.
- Multi-view carving with UNCE loss effectively refines reconstructed object geometry to align with observed data, removing over-smoothing artifacts typical of Poisson reconstruction.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.