Rotated Mean-Field Variational Inference and Iterative Gaussianization

• URL: http://arxiv.org/abs/2510.07732v1
• Date: Thu, 09 Oct 2025 03:13:44 GMT
• Title: Rotated Mean-Field Variational Inference and Iterative Gaussianization
• Authors: Yifan Chen, Sifan Liu,
• Abstract summary: We propose to perform mean-field variational inference (MFVI) in a rotated coordinate system.<n>MFVI in a rotated coordinate system defines a rotation and a coordinatewise map that together move the target closer to Gaussian.<n>Iterating this procedure yields a sequence of transformations that progressively transforms the target toward Gaussian.
• Score: 11.954133194037858
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose to perform mean-field variational inference (MFVI) in a rotated coordinate system that reduces correlations between variables. The rotation is determined by principal component analysis (PCA) of a cross-covariance matrix involving the target's score function. Compared with standard MFVI along the original axes, MFVI in this rotated system often yields substantially more accurate approximations with negligible additional cost. MFVI in a rotated coordinate system defines a rotation and a coordinatewise map that together move the target closer to Gaussian. Iterating this procedure yields a sequence of transformations that progressively transforms the target toward Gaussian. The resulting algorithm provides a computationally efficient way to construct flow-like transport maps: it requires only MFVI subproblems, avoids large-scale optimization, and yields transformations that are easy to invert and evaluate. In Bayesian inference tasks, we demonstrate that the proposed method achieves higher accuracy than standard MFVI, while maintaining much lower computational cost than conventional normalizing flows.

Related papers

• WUSH: Near-Optimal Adaptive Transforms for LLM Quantization [52.77441224845925]
  Quantization to low bitwidth is a standard approach for deploying large language models.<n>A few extreme weights and activations stretch the dynamic range and reduce the effective resolution of the quantizer.<n>We derive, for the first time, closed-form optimal linear blockwise transforms for joint weight-activation quantization.
  arXiv  Detail & Related papers  (2025-11-30T16:17:34Z)
• 3-Dimensional CryoEM Pose Estimation and Shift Correction Pipeline [2.009945677846956]
  Accurate pose estimation and shift correction are key challenges in cryo-EM due to the very low SNR, which directly impacts the fidelity of 3D reconstructions.<n>We present an approach for pose estimation in cryo-EM that leverages multi-dimensional scaling (MDS) techniques in a robust manner to estimate the 3D rotation matrix of each particle from pairs of dihedral angles.
  arXiv  Detail & Related papers  (2025-07-20T11:46:17Z)
• Rotation Averaging: A Primal-Dual Method and Closed-Forms in Cycle Graphs [6.511636092857915]
  A benchmark of geometric reconstruction, averaging seeks the set of absolute settings that optimally explains a set of measured relative orientations between them. We propose a novel primal-dual cycle method motivated by the widely accepted spectral theory.
  arXiv  Detail & Related papers  (2024-05-29T21:46:39Z)
• Decomposed Global Optimization for Robust Point Matching with Low-Dimensional Branching [41.05165517541873]
  We introduce a novel global optimization method for align partially overlapping point sets.<n>Our method exhibits superior robustness to non-rigid deformations, positional noise and outliers.<n> Experiments on 2D and 3D synthetic and real-world data demonstrate that our method, compared to state-of-the-art approaches, exhibits superior robustness to outliers.
  arXiv  Detail & Related papers  (2024-05-14T13:28:57Z)
• Revisiting Rotation Averaging: Uncertainties and Robust Losses [51.64986160468128]
  We argue that the main problem of current methods is the minimized cost function that is only weakly connected with the input data via the estimated epipolar. We propose to better model the underlying noise distributions by directly propagating the uncertainty from the point correspondences into the rotation averaging.
  arXiv  Detail & Related papers  (2023-03-09T11:51:20Z)
• Manifold Gaussian Variational Bayes on the Precision Matrix [70.44024861252554]
  We propose an optimization algorithm for Variational Inference (VI) in complex models. We develop an efficient algorithm for Gaussian Variational Inference whose updates satisfy the positive definite constraint on the variational covariance matrix. Due to its black-box nature, MGVBP stands as a ready-to-use solution for VI in complex models.
  arXiv  Detail & Related papers  (2022-10-26T10:12:31Z)
• Variational Kalman Filtering with Hinf-Based Correction for Robust Bayesian Learning in High Dimensions [2.294014185517203]
  We address the problem of convergence of sequential variational inference filter (VIF) through the application of a robust variational objective and Hinf-norm based correction. A novel VIF- Hinf recursion that employs consecutive variational inference and Hinf based optimization steps is proposed.
  arXiv  Detail & Related papers  (2022-04-27T17:38:13Z)
• Scalable Variational Gaussian Processes via Harmonic Kernel Decomposition [54.07797071198249]
  We introduce a new scalable variational Gaussian process approximation which provides a high fidelity approximation while retaining general applicability. We demonstrate that, on a range of regression and classification problems, our approach can exploit input space symmetries such as translations and reflections. Notably, our approach achieves state-of-the-art results on CIFAR-10 among pure GP models.
  arXiv  Detail & Related papers  (2021-06-10T18:17:57Z)
• Consistent and symmetry preserving data-driven interface reconstruction for the level-set method [0.0]
  We focus on interface reconstruction (IR) in the level-set method, i.e. the computation of the volume fraction and apertures. The proposed approach improves accuracy for coarsely resolved interfaces and recovers the conventional IR for high resolutions. We provide details of floating point symmetric implementation and computational efficiency.
  arXiv  Detail & Related papers  (2021-04-23T13:21:10Z)
• Pushing the Envelope of Rotation Averaging for Visual SLAM [69.7375052440794]
  We propose a novel optimization backbone for visual SLAM systems. We leverage averaging to improve the accuracy, efficiency and robustness of conventional monocular SLAM systems. Our approach can exhibit up to 10x faster with comparable accuracy against the state-art on public benchmarks.
  arXiv  Detail & Related papers  (2020-11-02T18:02:26Z)
• Gaussianization Flows [113.79542218282282]
  We propose a new type of normalizing flow model that enables both efficient iteration of likelihoods and efficient inversion for sample generation. Because of this guaranteed expressivity, they can capture multimodal target distributions without compromising the efficiency of sample generation.
  arXiv  Detail & Related papers  (2020-03-04T08:15:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.