Reproduce “A Better Critic Matters for Distribution Matching Distillation” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Zongze Wu, Xianbang Wang, Zhengyang Geng, Mingdeng Cao, Zhoutong Zhang, Richard Zhang, Eli Shechtman, Ruiming Cao

The authors study how teacher and critic capacity affect diffusion distillation and introduce STAC, which conditions the critic on the student’s generation step. In controlled ImageNet tests, a one-step student reaches FID 13.50 with an XL critic but 41.75 with a smaller B critic; STAC lowers four-step FID from 8.08 to 6.90. These findings are empirical, not a universal sizing rule.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.