Reproduce “TBR: Transport-Based Rendering with Deposition Strokes for Inverse Graphics” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Tianqi Liu, Yushan Han, Hang Liu
Researchers developed a system for inverse graphics in dynamic media like paper marbling, using a transport-coupled deposition stroke and a memory-efficient adjoint method. The system generates editable, resolution-independent programs from target images, reconstructing them with an average pixel MSE 3.67 times lower than a flat floor baseline and operating efficiently in about 4 minutes for 2000 strokes at 1024² resolution.
Key insights
- A novel "capsule" stroke primitive effectively models pigment displacement in dynamic media, where new deposits actively move existing patterns while preserving area outside the deposited material.
- The closed-form inverse of the transport map is fundamental, enabling both efficient forward rendering and a memory-efficient replay adjoint for gradient computation.
- Explicitly recording only the minimal information lost due to the non-injectivity of the deposition process allows for accurate and significantly more memory-efficient differentiation through long, interdependent stroke sequences.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.