Reproduce “InstanceAnimator: Multi-Instance Sketch Video Colorization” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Yinhan Zhang, Yue Ma, Bingyuan Wang, Kunyu Feng, Yeying Jin, Qifeng Chen, Anyi Rao, Zeyu Wang
InstanceAnimator colorizes supplied sketch sequences into videos using a canvas where artists arrange separate character instances and backgrounds. Instance-Aware Attention processes reference instances independently, while decoupled controls adjust instance, background, and text features. On 100 American-style, multi-character clips, it records FID 121.901 versus ToonComposer’s 132.319, but ToonComposer leads on CLIP Score; these test results use different inputs.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.