Reproduce “Duo: A Reciprocal World Model for Full-Duplex Interaction” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Hengyuan Cao, Biao Gong, Guoshan Lu, Qiyuan Zhang, Lin Liu, Yiding Tian, Yilei Jiang, Yuxin Ma and 12 more
Duo v1 combines an Intent module, which chooses whether to speak or wait, with a Realization module that generates synchronized video and audio. It processes interaction in 17-frame chunks and feeds generated responses into later chunks. In 30 audiovisual exchanges, 168 of 180 checks passed (93.3%), while responsiveness passed in 22 of 30; the system remains preliminary.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.