Reproduce “Segment Anything for Cell Tracking” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Zhu Chen, Mert Edgü, Er Jin, Johannes Stegmaier

The research presents an unsupervised, zero-shot framework for cell tracking that leverages pre-trained Segment Anything 2 (SAM2) and SAM-Med3D. This pipeline accurately tracks cells and generates segmentation masks across diverse 2D and large-scale 3D+t microscopy datasets without requiring manual annotation or dataset-specific training.

Key insights

  • Pre-trained foundation models like SAM2 and SAM-Med3D can be effectively adapted for specialized scientific tasks like cell tracking without further domain-specific training.
  • A zero-shot, unsupervised approach can achieve competitive accuracy against supervised state-of-the-art methods, significantly reducing reliance on manual data annotation.
  • Combining local patch processing and intelligent prompting mechanisms with foundation models allows for robust generalization and efficient handling of diverse and large-scale microscopy data.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.