Reproduce “Predictive Style Matching: Natural and Robust Humanoid Locomotion” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Simeon Nedelchev, Ekaterina Chaikovskaia, Egor Davydenko, Eduard Zaliaev, Roman Gorbachev

Predictive Style Matching (PSM) introduces a two-stage method that enables humanoid robots to achieve human-like locomotion while maintaining robust disturbance recovery. The approach notably reduced upper-body style error by approximately 8-fold compared to task-only RL, without compromising fall rates or recovery times, and uses a policy-only deployment.

Key insights

  • State-conditioned style targets, predicted by `f_ϕ`, adapt to the robot's current motion and commands, allowing for natural movements without rigidly adhering to time-indexed references during critical recovery moments.
  • Integrating style rewards as exponential kernels, with a curriculum learning approach, allows the RL policy to learn human-like coordination while prioritizing core locomotion and recovery behaviors when necessary.
  • Decoupling the style prediction from the runtime policy ensures that the deployed controller maintains the simplicity, low latency, and robustness advantages of task-only RL.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.