Reproduce “Assessing Image Quality Using a Simple Generative Representation” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Simon Raviv, Gal Chechik

VAE-QA introduces an Image Quality Assessment method that utilizes generative representations from a pre-trained Variational Autoencoder, diverging from traditional discriminative approaches. This method shows improved cross-dataset generalization and reduced computational requirements while maintaining competitive performance on standard IQA benchmarks.

Key insights

  • Generative models, specifically VAEs, can preserve more visually relevant information for quality assessment compared to discriminative models.
  • Utilizing pre-trained VAE encoders for feature extraction enables strong performance and generalization without extensive IQA-specific training.
  • Fusing multi-layer features from a VAE's encoder, combined with a simple MLP, can effectively predict image quality.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.