Reproduce “Disentangled Point Diffusion for Precise Object Placement” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Lyuxing He, Eric Cai, Shobhit Aggarwal, Jianjun Wang, David Held

TAX-DPD predicts final point clouds in two stages: a scene-level model selects a rough location, then diffusion refines shape and position. Point diffusion succeeds on 95% of ManyMugs trials, versus 89% for an SE(3)-diffusion ablation, and 98% versus 97% on fixed-geometry OneMug. This supports an advantage on varied geometries, not universal superiority.

Key insights

  • Point cloud diffusion, particularly when disentangled, offers superior accuracy and generalization across varying object geometries compared to SE(3) pose prediction, even for rigid object placement.
  • A hierarchical approach that first addresses global scene-level multi-modality with a Dense GMM before local refinement significantly improves the effectiveness and precision of object placement.
  • Disentangling the point cloud diffusion process into separate denoising tasks for object shape and its placement frame is crucial for achieving high-fidelity, precise goal configurations in complex manipulation scenarios.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.