Reproduce “HandUMI: A Modular Hand-Worn Parallel-Jaw Interface for Robot-Free Bimanual Data Capture” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Brik Meza, Leonardo Perez, Alvaro Mendoza-Li, Aniela Ubillus, Mitshell Ramos, Raul Bastidas, Mauricio Olivera, Bryan Bastidas

HandUMI lets operators record demonstrations without access to the robot, using a hand-held interface with interchangeable tips matched to the robot’s gripper and translating parallel jaws. Inverse kinematics retargets recordings to robot arms; seven-arm results are simulated. On physical PiPER arms, ACT trained on 562 demonstrations folded a towel in 12 of 20 attempts; this is one task and setup.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.