SubZero: Subspace Zero-Shot MRI Reconstruction

• URL: http://arxiv.org/abs/2311.17251v1
• Date: Tue, 28 Nov 2023 22:16:51 GMT
• Title: SubZero: Subspace Zero-Shot MRI Reconstruction
• Abstract summary: Recently introduced zero-shot self-supervised learning (ZS-SSL) has shown potential in accelerated MRI in a scan-specific scenario. We propose a parallel network framework and introduce an attention mechanism to improve subspace-based learning.
• Score: 4.725428444472479
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently introduced zero-shot self-supervised learning (ZS-SSL) has shown potential in accelerated MRI in a scan-specific scenario, which enabled high-quality reconstructions without access to a large training dataset. ZS-SSL has been further combined with the subspace model to accelerate 2D T2-shuffling acquisitions. In this work, we propose a parallel network framework and introduce an attention mechanism to improve subspace-based zero-shot self-supervised learning and enable higher acceleration factors. We name our method SubZero and demonstrate that it can achieve improved performance compared with current methods in T1 and T2 mapping acquisitions.

Related papers

• Unveiling the Secret of AdaLN-Zero in Diffusion Transformer [54.52619563900124]
  Diffusion transformer (DiT) is a rapidly emerging architecture for image generation.<n>We investigate a critical conditioning mechanism within DiT, adaLN-Zero, which achieves superior performance compared to adaLN.<n>We introduce an improved conditioning mechanism called SE-adaLN-Zero.
  arXiv  Detail & Related papers  (2026-08-10T11:12:17Z)
• Physics-Driven Zero-Shot MRI Reconstruction with Non-local Image Priors [3.412182028038034]
  ZS-SSL has emerged as a promising paradigm for accelerated Magnetic Resonance Imaging (MRI) reconstruction.<n>We propose a robust physics-driven framework that synergizes physical consistency with image-domain non-local priors.<n>Our approach achieves state-of-the-art performance, particularly under high acceleration factors.
  arXiv  Detail & Related papers  (2026-06-13T04:57:19Z)
• R2R2: Robust Representation for Intensive Experience Reuse via Redundancy Reduction in Self-Predictive Learning [40.03346193264488]
  We propose Robust Representation via Redundancy Reduction (R2R2) as a regularization method within Self-Predictive Learning (SPL)<n>We verify R2R2 on SPL-native algorithms like TD7.<n> Experiments across 11 continuous control tasks confirm that R2R2 effectively mitigates overfitting.
  arXiv  Detail & Related papers  (2026-05-13T18:38:32Z)
• Echo State Networks as State-Space Models: A Systems Perspective [10.710447183485284]
  We show that the echo-state property is an instance of input-to-state stability for a contractive nonlinear SSM.<n>We also develop two complementary mappings that yield locally valid LTI SSMs with interpretable poles and memory horizons.<n>This perspective yields frequency-domain characterizations of memory spectra and clarifies when ESNs emulate structured SSM kernels.
  arXiv  Detail & Related papers  (2025-09-04T17:42:03Z)
• Dual Guidance Semi-Supervised Action Detection [71.45023660211145]
  We present a semi-supervised approach for spatial-temporal action localization.<n>We introduce a dual guidance network to select better pseudo-bounding boxes.<n>Our framework achieves superior results compared to extended image-based semi-supervised baselines.
  arXiv  Detail & Related papers  (2025-07-28T18:08:36Z)
• C2D-ISR: Optimizing Attention-based Image Super-resolution from Continuous to Discrete Scales [6.700548615812325]
  We propose a novel framework, textbfC2D-ISR, for optimizing attention-based image super-resolution models. Our approach is based on a two-stage training methodology and a hierarchical encoding mechanism. In addition, we generalize the hierarchical encoding mechanism with existing attention-based network structures.
  arXiv  Detail & Related papers  (2025-03-17T21:52:18Z)
• ADASR: An Adversarial Auto-Augmentation Framework for Hyperspectral and Multispectral Data Fusion [54.668445421149364]
  Deep learning-based hyperspectral image (HSI) super-resolution aims to generate high spatial resolution HSI (HR-HSI) by fusing hyperspectral image (HSI) and multispectral image (MSI) with deep neural networks (DNNs) In this letter, we propose a novel adversarial automatic data augmentation framework ADASR that automatically optimize and augments HSI-MSI sample pairs to enrich data diversity for HSI-MSI fusion.
  arXiv  Detail & Related papers  (2023-10-11T07:30:37Z)
• CLEANing Cygnus A deep and fast with R2D2 [1.7249361224827533]
  A novel deep learning paradigm for synthesis imaging by radio interferometry in astronomy was recently proposed, dubbed "Residual-to-Residual DNN series for high-Dynamic range imaging" (R2D2) We show that R2D2's learning approach enables delivering high-precision imaging, superseding the resolution of CLEAN, and matching the precision of modern optimization and plug-and-play algorithms, respectively uSARA and AIRI.
  arXiv  Detail & Related papers  (2023-09-06T18:11:09Z)
• AdaSAM: Boosting Sharpness-Aware Minimization with Adaptive Learning Rate and Momentum for Training Deep Neural Networks [76.90477930208982]
  Sharpness aware (SAM) has been extensively explored as it can generalize better for training deep neural networks. Integrating SAM with adaptive learning perturbation and momentum acceleration, dubbed AdaSAM, has already been explored. We conduct several experiments on several NLP tasks, which show that AdaSAM could achieve superior performance compared with SGD, AMS, and SAMsGrad.
  arXiv  Detail & Related papers  (2023-03-01T15:12:42Z)
• BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performance [54.214426436283134]
  Deep neural networks, such as the Deep-FSMN, have been widely studied for keyword spotting (KWS) applications. We present a strong yet efficient binary neural network for KWS, namely BiFSMNv2, pushing it to the real-network accuracy performance. We highlight that benefiting from the compact architecture and optimized hardware kernel, BiFSMNv2 can achieve an impressive 25.1x speedup and 20.2x storage-saving on edge hardware.
  arXiv  Detail & Related papers  (2022-11-13T18:31:45Z)
• Temporal superimposed crossover module for effective continuous sign language [10.920363368754721]
  This paper proposes a zero parameter, zero temporal superposition crossover module(TSCM), and combines it with 2D convolution to form a "TSCM+2D convolution" hybrid convolution. Experiments on two large-scale continuous sign language datasets demonstrate the effectiveness of the proposed method and achieve highly competitive results.
  arXiv  Detail & Related papers  (2022-11-07T09:33:42Z)
• PUERT: Probabilistic Under-sampling and Explicable Reconstruction Network for CS-MRI [47.24613772568027]
  Compressed Sensing MRI aims at reconstructing de-aliased images from sub-Nyquist sampling k-space data to accelerate MR Imaging. We propose a novel end-to-end Probabilistic Under-sampling and Explicable Reconstruction neTwork, dubbed PUERT, to jointly optimize the sampling pattern and the reconstruction network. Experiments on two widely used MRI datasets demonstrate that our proposed PUERT achieves state-of-the-art results in terms of both quantitative metrics and visual quality.
  arXiv  Detail & Related papers  (2022-04-24T04:23:57Z)
• One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI [19.942978606567547]
  Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI) Most state-of-the-art deep learning reconstructions adopt the powerful convolutional neural network and perform 2D convolution. We present a new approach that explores the 1D convolution, making the deep network much easier to be trained and generalized.
  arXiv  Detail & Related papers  (2021-12-09T06:39:55Z)
• Optical-Flow-Reuse-Based Bidirectional Recurrent Network for Space-Time Video Super-Resolution [52.899234731501075]
  Space-time video super-resolution (ST-VSR) simultaneously increases the spatial resolution and frame rate for a given video. Existing methods typically suffer from difficulties in how to efficiently leverage information from a large range of neighboring frames. We propose a coarse-to-fine bidirectional recurrent neural network instead of using ConvLSTM to leverage knowledge between adjacent frames.
  arXiv  Detail & Related papers  (2021-10-13T15:21:30Z)
• eRAKI: Fast Robust Artificial neural networks for K-space Interpolation (RAKI) with Coil Combination and Joint Reconstruction [8.466186229613546]
  RAKI can perform database-free MRI reconstruction by training models using only auto-calibration signal (ACS) from each specific scan. As it trains a separate model for each individual coil, learning and inference with RAKI can be computationally prohibitive, particularly for large 3D datasets. In this abstract, we accelerate RAKI more than 200 times by directly learning a coil-combined target and further improve the reconstruction performance using joint reconstruction across multiple echoes.
  arXiv  Detail & Related papers  (2021-07-07T12:52:13Z)
• Two-Stage Self-Supervised Cycle-Consistency Network for Reconstruction of Thin-Slice MR Images [62.4428833931443]
  The thick-slice magnetic resonance (MR) images are often structurally blurred in coronal and sagittal views. Deep learning has shown great potential to re-construct the high-resolution (HR) thin-slice MR images from those low-resolution (LR) cases. We propose a novel Two-stage Self-supervised Cycle-consistency Network (TSCNet) for MR slice reconstruction.
  arXiv  Detail & Related papers  (2021-06-29T13:29:18Z)
• A journey in ESN and LSTM visualisations on a language task [77.34726150561087]
  We trained ESNs and LSTMs on a Cross-Situationnal Learning (CSL) task. The results are of three kinds: performance comparison, internal dynamics analyses and visualization of latent space.
  arXiv  Detail & Related papers  (2020-12-03T08:32:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.