Reproduce “Object-level Geometric Structure Preserving for Natural Image Stitching” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Wenxiao Cai, Wankou Yang

OBJ-GSP, developed by Southeast University, is an image stitching algorithm that integrates state-of-the-art semantic segmentation with geometric optimization to preserve object-level structures, yielding more natural-looking panoramas. This method achieves superior distortion prevention and alignment, especially for challenging low-altitude aerial imagery, and introduces the comprehensive StitchBench dataset.

Key insights

  • Achieving natural-looking stitched images requires preserving the geometric integrity of entire objects, a more holistic approach than focusing solely on line structures.
  • State-of-the-art semantic segmentation models, such as SAM, provide the necessary capability to robustly extract object-level contours, enabling their direct integration into geometric stitching pipelines.
  • Successfully stitching low-altitude aerial imagery, often complicated by parallax, necessitates semantically segmenting relevant scene components (e.g., roofs, walls) and applying orthorectification before general stitching.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.