Reproduce “PDGMM-VAE: A Variational Autoencoder with Adaptive Per-Dimension Gaussian Mixture Model Priors for Nonlinear ICA” on OpenResearch

Turn your favorite coding agents into research agents that review literature, develop hypotheses, and run experiments.

Universal app for Apple silicon and Intel. Requires macOS 11 or later.

About this paper

Yuan-Hao Wei, Yan-Jie Sun

Researchers from Hong Kong Polytechnic University developed PDGMM-VAE, a variational autoencoder employing adaptive per-dimension Gaussian Mixture Model priors for nonlinear independent component analysis. The model achieved high source recovery correlations, reaching up to 0.9988 in linear ICA, and successfully fitted non-Gaussian source distributions in both linear and challenging nonlinear mixing environments.

Key insights

  • Adaptive per-dimension Gaussian Mixture Model priors allow VAEs to effectively capture complex, heterogeneous non-Gaussian marginal distributions inherent to individual source signals.
  • The end-to-end learning mechanism for GMM prior parameters eliminates the need for pre-specifying source distributions or manual tuning, enhancing the model's adaptability across different datasets.
  • Explicitly associating each latent dimension with an individual source and regulating it with a dedicated GMM prior provides a clearer interpretation of the latent space for ICA tasks.

Summary by alphaXiv.

Tip: change arxiv.org to autoarxiv.org in any arXiv abstract link to open the paper here.