Reproduce “SemVecNet: Generalizable Vector Map Generation for Arbitrary Sensor Configurations” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Narayanan Elavathur Ranganatha, Hengyuan Zhang, Shashank Venkatramani, Jing-Yan Liao, Henrik I. Christensen

SemVecNet, from researchers at UCSD, introduces a modular pipeline for online vector map generation that significantly improves generalization to arbitrary sensor configurations. The method achieves this by first creating a sensor-robust intermediate Bird's-Eye-View semantic map, then feeding it to a vectorization module, demonstrating a performance transfer ratio of up to 33.1% on unseen datasets where prior end-to-end methods fail.

Key insights

  • Decoupling the sensor-to-BEV transformation from the vectorization process is crucial for achieving generalization across varying sensor configurations.
  • A probabilistic intermediate Bird's-Eye-View (BEV) semantic map, generated using projective geometry, provides a robust representation that is largely invariant to specific sensor setups.
  • Joint training of view transformation modules with downstream decoders in end-to-end vector map generation models leads to severe overfitting to specific sensor configurations.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.