Reproduce “Hierarchical Intention-Aware Expressive Motion Generation for Humanoid Robots” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Lingfan Bao, Yan Pan, Tianhu Peng, Dimitrios Kanoulas, Chengxu Zhou

Researchers at University College London developed HIAER, a hierarchical framework that enables humanoid robots to generate expressive, socially appropriate motions by interpreting human intent and affective state in real-time. The system demonstrated robust performance across various interaction scenarios, particularly in handling ambiguous social cues, on a physical Unitree G1 robot.

Key insights

  • Valence-Arousal (V-A) estimates derived from the VLM are crucial for dynamically conditioning motion generation, allowing a single motion primitive to convey different social meanings based on the perceived affective state.
  • The hierarchical design, combined with a confidence-aware fallback mechanism, provides superior robustness in ambiguous social situations by defaulting to safe, neutral gestures, preventing inappropriate robot responses.
  • Multimodal input, combining vision and language, significantly enhances intention inference accuracy (0.87 compared to 0.77 for vision-only) for robust social context reasoning.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.