Reproduce “Weighted boxes fusion: Ensembling boxes from different object detection models” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Roman Solovyev, Weimin Wang, Tatiana Gabruseva

Weighted Boxes Fusion (WBF) is an algorithm designed to combine bounding box predictions from multiple object detection models or test-time augmentations. It consistently improves Mean Average Precision (mAP) scores, demonstrating its utility in achieving higher accuracy and more precise object localization for both 2D and 3D detection tasks, such as reaching 56.1 mAP on the COCO validation set with a multi-model ensemble.

Key insights

  • WBF achieves superior performance by actively fusing information from multiple overlapping bounding boxes, rather than merely filtering them, thereby retaining and consolidating valuable predictions from ensembles.
  • The iterative recalculation of fused box coordinates using confidence-weighted averaging significantly refines localization accuracy by averaging out individual model errors and prioritizing more certain predictions.
  • The method demonstrates strong generalizability and versatility, proving effective across diverse 2D object detection architectures and successfully extending to complex 3D object detection tasks.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.