Image space formalism of convolutional neural networks for k-space interpolation

• URL: http://arxiv.org/abs/2402.17410v2
• Date: Fri, 09 May 2025 10:02:55 GMT
• Title: Image space formalism of convolutional neural networks for k-space interpolation
• Authors: Peter Dawood, Felix Breuer, Istvan Homolya, Maximilian Gram, Peter M. Jakob, Moritz Zaiss, Martin Blaimer,
• Abstract summary: Noise resilience in image reconstructions by scan-specific robust artificial neural networks for k-space (RAKI) is linked to nonlinear activations in k-space.<n>An image space formalism of RAKI is introduced for analyzing noise propagation analytically and to describe the role of nonlinear activations in a human readable manner.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Purpose: Noise resilience in image reconstructions by scan-specific robust artificial neural networks for k-space interpolation (RAKI) is linked to nonlinear activations in k-space. To gain a deeper understanding of this relationship, an image space formalism of RAKI is introduced for analyzing noise propagation analytically, identifying and characterizing image reconstruction features and to describe the role of nonlinear activations in a human readable manner. Methods: The image space formalism for RAKI inference is employed by expressing nonlinear activations in k-space as element-wise multiplications with activation masks, which transform into convolutions in image space. Jacobians of the de-aliased, coil-combined image relative to the aliased coil images can be expressed algebraically, and thus, the noise amplification is quantified analytically (g-factor maps). We analyze the role of nonlinearity for noise resilience by controlling the degree of nonlinearity in the reconstruction model via the negative slope parameter in leaky ReLU. Results: The analytical g-factor maps correspond with those obtained from Monte Carlo simulations and from an auto differentiation approach for in vivo brain images. Apparent blurring and contrast loss artifacts are identified as implications of enhanced noise resilience. These residual artifacts can be traded against noise resilience by adjusting the degree of nonlinearity in the model (Tikhonov-like regularization) in case of limited training data. The inspection of image space activations reveals an autocorrelation pattern leading to a potential center artifact. Conclusion: The image space formalism of RAKI provides the means for analytical quantitative noisepropagation analysis and human-readable visualization of the effects of the nonlinear activation functions in k-space.

Related papers

• Physics-Guided Dual Implicit Neural Representations for Source Separation [70.38762322922211]
  We develop a self-supervised machine-learning approach for source separation using a dual implicit neural representation framework.<n>Our method learns directly from the raw data by minimizing a reconstruction-based loss function.<n>Our method offers a versatile framework for addressing source separation problems across diverse domains.
  arXiv  Detail & Related papers  (2025-07-07T17:56:31Z)
• Denoising and Reconstruction of Nonlinear Dynamics using Truncated Reservoir Computing [0.0]
  This paper presents a novel Reservoir Computing (RC) method for noise filtering and reconstructing unobserved nonlinear dynamics.<n>The performance of the RC in terms of noise intensity, noise frequency content, and drastic shifts in dynamical parameters is studied.<n>The framework yields competitive accuracy at low signal-to-noise ratios and high-frequency ranges.
  arXiv  Detail & Related papers  (2025-04-17T21:47:13Z)
• FreSca: Unveiling the Scaling Space in Diffusion Models [52.20473039489599]
  Diffusion models offer impressive controllability for image tasks, primarily through noise predictions that encode task-specific information and guidance enabling adjustable scaling. We investigate this space, starting with inversion-based editing where the difference between conditional/unconditional noise predictions carries key semantic information. Our core contribution stems from a Fourier analysis of noise predictions, revealing that its low- and high-frequency components evolve differently throughout diffusion. Based on this insight, we introduce FreSca, a straightforward method that applies guidance scaling independently to different frequency bands in the Fourier domain.
  arXiv  Detail & Related papers  (2025-04-02T22:03:11Z)
• Dynamic PET Image Reconstruction via Non-negative INR Factorization [2.6408529601818422]
  We introduce an unsupervised learning approach, Non-negative Implicit Neural Representation Factorization (textttNINRF), based on low rank matrix factorization of unknown images.<n>Experiments on dynamic PET reconstruction with Poisson noise demonstrate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2025-03-11T04:13:30Z)
• Ray-driven Spectral CT Reconstruction Based on Neural Base-Material Fields [10.684377265644045]
  In spectral CT reconstruction, the basis materials decomposition involves solving a large-scale nonlinear system of integral equations. This paper proposes a model that parameterizes the attenuation coefficients of the object using a neural field representation. It introduces a lightweight discretization method for line integrals based on a ray-driven neural field.
  arXiv  Detail & Related papers  (2024-04-10T13:10:52Z)
• Image segmentation with traveling waves in an exactly solvable recurrent neural network [71.74150501418039]
  We show that a recurrent neural network can effectively divide an image into groups according to a scene's structural characteristics. We present a precise description of the mechanism underlying object segmentation in this network. We then demonstrate a simple algorithm for object segmentation that generalizes across inputs ranging from simple geometric objects in grayscale images to natural images.
  arXiv  Detail & Related papers  (2023-11-28T16:46:44Z)
• Neural Spherical Harmonics for structurally coherent continuous representation of diffusion MRI signal [0.3277163122167433]
  We present a novel way to model diffusion magnetic resonance imaging (dMRI) datasets, that benefits from the structural coherence of the human brain. Current methods model the dMRI signal in individual voxels, disregarding the intervoxel coherence that is present. We use a neural network to parameterize a spherical harmonics series to represent the dMRI signal of a single subject from the Human Connectome Project dataset.
  arXiv  Detail & Related papers  (2023-08-16T08:28:01Z)
• SO(2) and O(2) Equivariance in Image Recognition with Bessel-Convolutional Neural Networks [63.24965775030674]
  This work presents the development of Bessel-convolutional neural networks (B-CNNs) B-CNNs exploit a particular decomposition based on Bessel functions to modify the key operation between images and filters. Study is carried out to assess the performances of B-CNNs compared to other methods.
  arXiv  Detail & Related papers  (2023-04-18T18:06:35Z)
• Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Back [84.61160272624262]
  We define tangent bundle filters and tangent bundle neural networks (TNNs) based on this convolution operation. Tangent bundle filters admit a spectral representation that generalizes the ones of scalar manifold filters, graph filters and standard convolutional filters in continuous time. We numerically evaluate the effectiveness of the proposed architecture on various learning tasks.
  arXiv  Detail & Related papers  (2023-03-20T17:57:15Z)
• Tensor Factorization via Transformed Tensor-Tensor Product for Image Alignment [3.0969191504482243]
  We study the problem of a batch of linearly correlated image alignment, where the observed images are deformed by some unknown domain transformations. By stacking these images as the frontal slices of a third-order tensor, we propose to explore the low-rankness of the underlying tensor.
  arXiv  Detail & Related papers  (2022-12-12T05:52:26Z)
• Analysis of convolutional neural network image classifiers in a rotationally symmetric model [4.56877715768796]
  The rate of convergence of the misclassification risk of the estimates towards the optimal misclassification risk is analyzed. It is shown that least squares plug-in classifiers based on convolutional neural networks are able to circumvent the curse of dimensionality in binary image classification.
  arXiv  Detail & Related papers  (2022-05-11T13:43:13Z)
• Hyperspectral Mixed Noise Removal via Subspace Representation and Weighted Low-rank Tensor Regularization [10.131033322742363]
  We employ subspace representation and the weighted low-rank tensor regularization (SWLRTR) into the model to remove the mixed noise in the hyperspectral image. Experiments demonstrate that the SWLRTR method performs better than other hyperspectral denoising methods quantitatively and visually.
  arXiv  Detail & Related papers  (2021-11-13T05:30:56Z)
• Moment evolution equations and moment matching for stochastic image EPDiff [68.97335984455059]
  Models of image deformation allow study of time-continuous effects transforming images by deforming the image domain. Applications include medical image analysis with both population trends and random subject specific variation. We use moment approximations of the corresponding Ito diffusion to construct estimators for statistical inference in the parameters full model.
  arXiv  Detail & Related papers  (2021-10-07T11:08:11Z)
• Convolutional Filtering and Neural Networks with Non Commutative Algebras [153.20329791008095]
  We study the generalization of non commutative convolutional neural networks. We show that non commutative convolutional architectures can be stable to deformations on the space of operators.
  arXiv  Detail & Related papers  (2021-08-23T04:22:58Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Noise Reduction in X-ray Photon Correlation Spectroscopy with Convolutional Neural Networks Encoder-Decoder Models [0.0]
  We propose a computational approach for improving the signal-to-noise ratio in two-time correlation functions. CNN-ED models are based on Convolutional Neural Network-Decoder (CNN-ED) models. We demonstrate that the CNN-ED models trained on real-world experimental data help to effectively extract equilibrium dynamics parameters from two-time correlation functions.
  arXiv  Detail & Related papers  (2021-02-07T18:38:59Z)
• Sampling in Combinatorial Spaces with SurVAE Flow Augmented MCMC [83.48593305367523]
  Hybrid Monte Carlo is a powerful Markov Chain Monte Carlo method for sampling from complex continuous distributions. We introduce a new approach based on augmenting Monte Carlo methods with SurVAE Flows to sample from discrete distributions. We demonstrate the efficacy of our algorithm on a range of examples from statistics, computational physics and machine learning, and observe improvements compared to alternative algorithms.
  arXiv  Detail & Related papers  (2021-02-04T02:21:08Z)
• Neural Dynamic Mode Decomposition for End-to-End Modeling of Nonlinear Dynamics [49.41640137945938]
  We propose a neural dynamic mode decomposition for estimating a lift function based on neural networks. With our proposed method, the forecast error is backpropagated through the neural networks and the spectral decomposition. Our experiments demonstrate the effectiveness of our proposed method in terms of eigenvalue estimation and forecast performance.
  arXiv  Detail & Related papers  (2020-12-11T08:34:26Z)
• Deep Network for Scatterer Distribution Estimation for Ultrasound Image Simulation [8.13909718726358]
  We demonstrate a convolutional neural network approach for probabilistic scatterer estimation from observed ultrasound data. In comparison with several existing approaches, we demonstrate in numerical simulations and with in-vivo images that the synthesized images from scatterer representations estimated with our approach closely match the observations.
  arXiv  Detail & Related papers  (2020-06-17T21:25:13Z)
• Residual-driven Fuzzy C-Means Clustering for Image Segmentation [152.609322951917]
  We elaborate on residual-driven Fuzzy C-Means (FCM) for image segmentation. Built on this framework, we present a weighted $ell_2$-norm fidelity term by weighting mixed noise distribution. The results demonstrate the superior effectiveness and efficiency of the proposed algorithm over existing FCM-related algorithms.
  arXiv  Detail & Related papers  (2020-04-15T15:46:09Z)
• Geometric Approaches to Increase the Expressivity of Deep Neural Networks for MR Reconstruction [41.62169556793355]
  Deep learning approaches have been extensively investigated to reconstruct images from accelerated magnetic resonance image (MRI) acquisition. It is not clear how to choose a suitable network architecture to balance the trade-off between network complexity and performance. This paper proposes a systematic geometric approach using bootstrapping and subnetwork aggregation to increase the expressivity of the underlying neural network.
  arXiv  Detail & Related papers  (2020-03-17T14:18:37Z)
• Residual-Sparse Fuzzy $C$-Means Clustering Incorporating Morphological Reconstruction and Wavelet frames [146.63177174491082]
  Fuzzy $C$-Means (FCM) algorithm incorporates a morphological reconstruction operation and a tight wavelet frame transform. We present an improved FCM algorithm by imposing an $ell_0$ regularization term on the residual between the feature set and its ideal value. Experimental results reported for synthetic, medical, and color images show that the proposed algorithm is effective and efficient, and outperforms other algorithms.
  arXiv  Detail & Related papers  (2020-02-14T10:00:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.