Reproduce “VideoGuard: Protecting Video Content from Unauthorized Editing” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Junjie Cao, Kaizhou Li, Xinchun Yu, Hongxiang Li, Xiaoping Zhang
Researchers from Tsinghua University and Peking University developed VideoGuard, a two-stage method to protect videos from unauthorized editing by diffusion models. The approach introduces imperceptible perturbations that cause video editing models to produce distorted and inconsistent outputs, effectively degrading the quality and temporal coherence of manipulated videos across various models and benchmarks.
Key insights
- Manipulating a video's inversion latent is critical for disrupting editing, as this latent space precisely retains the original video's motion patterns even when new content is generated.
- Jointly optimizing all frames' inversion latents and explicitly fusing motion information into the objective is essential for countering 3D attention mechanisms in video diffusion models and targeting temporal consistency during protection.
- Gradient-free metaheuristic algorithms like PSO can efficiently find imperceptible perturbations in the pixel space that effectively steer the DDIM inversion process towards a desired distorted latent.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.