Reproduce “MISSFormer: An Effective Medical Image Segmentation Transformer” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Xiaohong Huang, Zhifang Deng, Dandan Li, Xueguang Yuan

MISSFormer presents a U-shaped transformer architecture for medical image segmentation that robustly integrates both long-range dependencies and fine-grained local context. This model achieved state-of-the-art results, including 81.96% DSC on Synapse and 90.86% DSC on ACDC, notably by training from scratch on medical datasets without requiring large-scale natural image pre-training.

Key insights

  • The U-shaped architecture and skip connections are essential for effectively integrating multi-scale information in transformer-based medical image segmentation.
  • Redesigning the standard transformer's feed-forward network with recursive skip connections and Layer Normalization dramatically improves feature discrimination and gradient stability.
  • A dedicated multi-scale fusion module, the Enhanced Transformer Context Bridge, is critical for learning comprehensive global and local correlations across hierarchical features.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.