Reproduce “FastJAM: a Fast Joint Alignment Model for Images” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Omri Hirsch, Ron Shapira Weber, Shira Ifergane, Oren Freifeld

Researchers from Ben Gurion University of the Negev developed FastJAM, a graph-based framework that significantly accelerates image Joint Alignment by using sparse keypoint representations and Graph Neural Networks. This approach reduces alignment runtime to under 50 seconds from hours, while achieving state-of-the-art accuracy of 53.0 [email protected] on the SPair-71k benchmark.

Key insights

  • Sparse, carefully selected keypoints are sufficient for high-quality image alignment and drastically reduce computational and memory overhead compared to dense feature maps.
  • Graph Neural Networks effectively propagate global alignment constraints across an entire image collection, enabling consistent joint alignment.
  • An inverse-compositional geometric loss with Lie-algebraic parameterization provides stable and regularization-free optimization, simplifying model development and improving robustness.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.