Reproduce “MotionSpec: Spectral Trajectory Supervision for Motion-Consistent Video Generation” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Ziqi Ni, Rui Li, Shiqi Jiang, Wei Zhou
MotionSpec trains text-to-video generation with supervision for both local optical flow and longer-range motion trajectories. It transforms anchor-relative trajectories into temporal frequency components, aligning their amplitude and phase alongside a neighboring-frame flow loss. On Wan2.1-T2V-1.3B, STC reached 65.07 versus 64.60 for time-domain trajectories on VMBench Avg., in this reported setup.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.