Reproduce “SyncPro: Synchronous Reasoning and Responding for Proactive Streaming Video Understanding” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Xueyun Tian, Bingbing Xu, Jiaming Liu, Jinpeng Yu, Yang Shi, Yu Zhao, Ruihua Huang, Yuanzhuo Wang and 1 more
SyncPro uses separate Inner and Response paths for live-video assistants, letting evidence tracking and answers proceed independently. Each can remain silent or generate from shared history and the current frame, but neither sees the other’s current-turn output; only Response reaches the user. SyncPro-RL scores 41.2% on StreamingBench proactive accuracy at 2 seconds, versus Em-Garde’s 38.0% at 2 frames per second; SyncPro runs at 1.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.