Reproduce “GUS-IR: Gaussian Splatting with Unified Shading for Inverse Rendering” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Zhihao Liang, Hongdong Li, Kui Jia, Kailing Guo, Qi Zhang
GUS-IR, developed by a collaborative team from South China University of Technology, Australian National University, Chinese University of Hong Kong, and VIVO, introduces a unified shading framework for 3D Gaussian Splatting inverse rendering, achieving high-fidelity intrinsic decomposition for complex scenes with diverse materials, and enabling real-time relighting and material editing.
Key insights
- The shortest axis of a 3D Gaussian offers a geometrically strong and reliable indicator for surface normal orientation, improving normal estimation compared to learnable vector or residual methods.
- Combining the strengths of both forward (effective for diffuse blending) and deferred (precise for specular highlights) shading through dual supervision is crucial for disentangling material properties across diverse surface types.
- Storing dense, high-frequency binary occlusion information in cubemaps within 3D volumes provides a more accurate and artifact-free representation of ambient occlusion than low-frequency spherical harmonics approximations.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.