Reproduce “RoadVGGT: Road-Structure-Aware Feed-Forward Road Surface Reconstruction” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Han Jiao, Chen Liu, Jiakai Sun, Zhanjie Zhang, Mengyuan Yang, Yimeng Li, Mofan Zhou, Kun Zhan and 1 more

RoadVGGT, developed by researchers from Zhejiang University and Li Auto Inc., presents a feed-forward framework for reconstructing compact Gaussian road surfaces while maintaining awareness of fine road structures. The framework achieved superior image reconstruction quality (PSNR 25.71 on Waymo), significantly improved BEV semantic mapping (mIoU 0.4692), and better elevation accuracy (Z-RMSE 0.2312) compared to existing methods, all while generating more compact representations and demonstrating cross-dataset generalizability.

Key insights

  • A powerful geometric foundation model can be effectively adapted with a specialized Gaussian head and fusion strategy to enable efficient, feed-forward generation of explicit, renderable 3D representations.
  • Utilizing a 2D road-plane grid for fusion is more suitable for road surface reconstruction than generic 3D voxel grids or dense pixel-aligned Gaussians, optimizing for compactness while preserving quality.
  • Intelligent, structure-aware grouping during Gaussian fusion is critical for preventing blurring of fine details and maintaining the integrity of semantic and elevation boundaries on road surfaces.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.