Reproduce “Learning Additively Compositional Latent Actions for Embodied AI” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Hangxing Wei, Xiaoyu Chen, Chuheng Zhang, Tim Pearce, Jianyu Chen, Alex Lamb, Li Zhao, Jiang Bian

Researchers at Wuhan University, Tsinghua University, and Microsoft Research developed AC-LAM, a model that imposes an additive composition prior on continuous latent actions, yielding more structured and displacement-calibrated representations. This approach enhances downstream robotic policy learning, achieving improved success rates on both simulated and real-world manipulation tasks.

Key insights

  • Imposing an additive composition prior effectively regularizes continuous latent action spaces to reflect fundamental physical properties of motion.
  • This prior leads to the emergence of desirable algebraic properties, such as identity, inverse, and cycle consistency, and significantly improves motion magnitude calibration in latent actions.
  • Enforcing additive composition helps disentangle pure motion semantics by suppressing static scene information and future observation leakage, making latents more focused on actionable state changes.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.