Reproduce “Computer-Use Agents Are Embodied Generalists” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Pranjal Aggarwal, Sean Welleck
The authors present a computer-use agent that tackles tasks through software interfaces. It observes screenshots, acts through keyboard or mouse, and uses app-specific operations. On four competition test sets, entries placed first, second, third, and sixth; OpenSUN3D achieved AP25 36.52 versus 26.50 for the best other entry. These results concern app-mediated tasks, not live robot control.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.