Reproduce “GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Joanna Waczyńska, Piotr Borycki, Sławomir Tadeja, Jacek Tabor, Przemysław Spurek
GaMeS introduces a hybrid 3D scene representation that combines Gaussian Splatting with mesh-based or mesh-like structures, allowing for real-time editable scenes where Gaussian parameters automatically adapt to underlying geometric transformations. This framework enables interactive modifications and animations of 3D objects and human faces, achieving competitive reconstruction quality compared to static GS and other editable methods.
Key insights
- Directly linking Gaussian parameters (mean, covariance) to mesh face vertices allows for intuitive, mesh-like manipulation of 3D Gaussian Splatting scenes.
- By defining Gaussian orientation and scale based on triangle geometry (normal, edge vectors), the splats automatically conform to surface deformations during mesh transformations.
- A "Triangle Soup" approach can provide editing capabilities even without a pre-existing mesh, by estimating triangular structures from initial flat Gaussians.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.