Reproduce “Multistable Shape from Shading Emerges from Patch Diffusion” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Xinran Nicole Han, Todd Zickler, Ko Nishino

The authors present a patchwise diffusion model that infers surface normals from grayscale shading while preserving competing shape interpretations. It coordinates neighboring patches for coherent surfaces and uses multiscale sampling and lighting-consistency guidance. On the “four circles” stimulus, its samples are closer than Wonder3D’s to a reference distribution containing both convex and concave shapes, but this is not a measure of human perception.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.