Reproduce “Generalizing Manipulation Skills with a Local Coding Agent” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Raman Talwar, Elias Nijs, Andreas Verleysen, Francis wyffels

The authors present a locally run vision-language coding agent that adapts hand-written robot skills to new object variations. Using Qwen3.8-27B, it remeasures scenes, writes and executes perception and control code, and verifies outcomes on a UR3e. It completed 30 of 45 trials without intervention across nine toy tasks, within tested object and task variation only.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.