Reproduce “Animated 3DGS Avatars in Diverse Scenes with Consistent Lighting and Shadows” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Aymen Mir, Riza Alp Guler, Jian Wang, Gerard Pons-Moll, Bing Zhou
Researchers from the University of Tübingen and Snap Inc. developed a method to render animated 3D Gaussian Splatting (3DGS) avatars with consistent lighting and realistic shadows within diverse 3DGS scenes. The approach significantly improves visual realism and coherence, demonstrated through quantitative metrics and a user study.
Key insights
- Closed-form computation of optical depth along light rays through Gaussian splats enables a direct volumetric approach to shadow casting without requiring explicit meshing or voxelization.
- Utilizing an octahedral atlas for directional parameterization and storage of precomputed transmittance offers improved angular uniformity and avoids artifacts common with cubemap-based methods for volumetric shadow maps.
- Approximating incident radiance with Spherical Harmonic (SH) coefficients from rendered cubemaps allows for fast and stable per-frame relighting of avatar Gaussians by modulating their colors, bypassing expensive inverse rendering.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.