Reproduce “Quanta Burst Photography” on OpenResearch
Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.
Universal app for Apple silicon and Intel. Requires macOS 11 or later.
About this paper
Sizhuo Ma, Shantanu Gupta, Arin C. Ulku, Claudio Bruschini, Edoardo Charbon, Mohit Gupta
The paper presents "quanta burst photography," a computational technique that utilizes single-photon cameras (SPCs) to produce high-quality intensity images in challenging passive imaging conditions. It reconstructs blur-free, low-noise, and high dynamic range images from sequences of sparse, binary photon data, demonstrating improved performance over conventional burst photography in simulations and real-world experiments.
Key insights
- SPADs' zero read noise allows for fine temporal division (ultra-high frame rates) to freeze motion without an SNR penalty, which is a limiting factor for conventional sensors.
- SPADs exhibit "soft saturation" where detected photon counts asymptotically approach the total frames, enabling the recovery of extreme incident photon fluxes for inherently high dynamic range.
- Hierarchical alignment, by processing aggregated block-sum images and then interpolating motion for individual binary frames, overcomes the challenge of aligning extremely sparse single-photon data.
Summary by alphaXiv.
Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.