Reproduce “Dynamics as Code: On Model Compression via Dynamic System” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Fan Gao, Wei Su, Juntong Fan, Renfeng Peng, Hongyu Liu, Jinqiao Duan, Feng-Lei Fan
The authors introduce a weight-compression framework that replaces groups of weights with indices into states generated by deterministic paths, then reconstructs them during decompression. It compares eight mappings across four families and gives a conditional coverage bound for irrational winding. On Qwen1.5-7B, Hilbert achieves 3.00× weight compression with WikiText-2 perplexity rising from 11.30 to 11.81; activations and KV caches remain FP16.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.