Data-Efficient Networks for Multi-Contrast MRI Reconstruction based on a Generalized Content/Style Prior

• URL: http://arxiv.org/abs/2609.01959v1
• Date: Wed, 02 Sep 2026 00:29:17 GMT
• Title: Data-Efficient Networks for Multi-Contrast MRI Reconstruction based on a Generalized Content/Style Prior
• Abstract summary: We propose a modular framework, namely CoSMo-RecNet, for learning guided reconstruction models in the low-data regime.<n>At its core is a reusable multi-contrast representation based on a content/style model, which can be learned from large-scale, publicly accessible, unpaired multi-contrast image datasets.<n>We demonstrate the efficacy of CoSMo-RecNet by evaluating it on the low-field 0.3 T M4Raw dataset, showing stable reconstruction quality on decreasing the raw training data budget.
• Score: 2.67054078828348
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-contrast MR scans contain redundant structural information that can be leveraged during reconstruction and potentially accelerate acquisition times. This idea has inspired end-to-end guided reconstruction models, leveraging one or more contrasts to guide the reconstruction of a different contrast. However, these models require large paired multi-contrast raw datasets for training, limiting their application in low-data regimes. In this work, we propose a modular framework, namely CoSMo-RecNet, for learning guided reconstruction models in the low-data regime. At its core is a reusable multi-contrast representation based on a content/style model, which can be learned from large-scale, publicly accessible, unpaired multi-contrast image datasets, without available k-space data. Using this frozen model as a multi-contrast prior and using a set of reference contrasts, the reconstruction problem reduces to a much simpler refinement problem that can be solved by a lightweight unrolled network and thus learned from small, task-specific reconstruction datasets. We demonstrate the efficacy of CoSMo-RecNet by evaluating it on the low-field 0.3 T M4Raw dataset, showing stable reconstruction quality on decreasing the raw training data budget. CoSMo-RecNet achieved higher reconstruction quality with 5 training subjects or lower compared to a parameter-count-matched MoDL trained on 100 subjects. On a data-limited and severely out-of-distribution ultra-low-field 47 mT Halbach scanner dataset, CoSMo-RecNet was superior to other viable strategies, including classical reconstruction, transfer learning, and zero-shot reconstruction.

Related papers

• Universal Image Restoration via Internalized Chain-of-Thought Reasoning [52.763760468548504]
  Image restoration seeks to recover high-quality images from degraded inputs but becomes highly ill-posed under complex, mixed degradations.<n>Recent works adopt Chain-of-Thought (CoT) reasoning for multi-round restoration using specialized modules.<n>We introduce CoTIR, a universal image restoration framework that internalizes CoT reasoning within a single model.
  arXiv  Detail & Related papers  (2026-06-16T06:01:36Z)
• Next-Acceleration-Scale Prediction for Autoregressive MRI Reconstruction [52.32112533846212]
  MRI reconstruction is an inherently ill-posed inverse problem, since incomplete measurements admit many plausible solutions.<n>We address this limitation by moving reconstruction to discrete multi-scale latent space and posing it as autoregressive next-acceleration-scale prediction.<n>We show that our approach delivers improved reconstruction performance across diverse sampling patterns under extreme undersampling.
  arXiv  Detail & Related papers  (2026-05-19T04:40:50Z)
• Reliev3R: Relieving Feed-forward Reconstruction from Multi-View Geometric Annotations [98.66466590444553]
  We propose Reliev3R, a weakly-supervised paradigm for training FFRMs from scratch without cost-prohibitive multi-view geometric annotations.<n>At the core of Reliev3R, we design an ambiguity-aware relative depth loss and a trigonometry-based reprojection loss to facilitate supervision for multi-view geometric consistency.
  arXiv  Detail & Related papers  (2026-04-01T06:46:54Z)
• A Plug-and-Play Method for Guided Multi-contrast MRI Reconstruction based on Content/Style Modeling [1.1286219853072859]
  We propose a modular two-stage approach to multi-contrast MRI reconstruction.<n>A content/style model of two-contrast image data is learned from a largely unpaired image-domain dataset.<n>The disentanglement of content and style allows explicit representation of contrast-independent and contrast-specific factors.
  arXiv  Detail & Related papers  (2024-09-20T13:08:51Z)
• MOST: MR reconstruction Optimization for multiple downStream Tasks via continual learning [12.0749219807816]
  Cascading separately trained reconstruction network and downstream task network has been shown to introduce performance degradation.<n>We extend this optimization to sequentially introduced multiple downstream tasks and demonstrate that a single MR reconstruction network can be optimized for multiple downstream tasks.
  arXiv  Detail & Related papers  (2024-09-16T15:31:04Z)
• Learning from History: Task-agnostic Model Contrastive Learning for Image Restoration [79.04007257606862]
  This paper introduces an innovative method termed 'learning from history', which dynamically generates negative samples from the target model itself. Our approach, named Model Contrastive Learning for Image Restoration (MCLIR), rejuvenates latency models as negative models, making it compatible with diverse image restoration tasks.
  arXiv  Detail & Related papers  (2023-09-12T07:50:54Z)
• Learning Detail-Structure Alternative Optimization for Blind Super-Resolution [69.11604249813304]
  We propose an effective and kernel-free network, namely DSSR, which enables recurrent detail-structure alternative optimization without blur kernel prior incorporation for blind SR. In our DSSR, a detail-structure modulation module (DSMM) is built to exploit the interaction and collaboration of image details and structures. Our method achieves the state-of-the-art against existing methods.
  arXiv  Detail & Related papers  (2022-12-03T14:44:17Z)
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction [68.80715727288514]
  We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix. In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
  arXiv  Detail & Related papers  (2022-09-15T03:58:30Z)
• Rethinking the optimization process for self-supervised model-driven MRI reconstruction [16.5013498806588]
  K2Calibrate is a K-space adaptation strategy for self-supervised model-driven MR reconstruction optimization. It can reduce the network's reconstruction deterioration caused by statistically dependent noise. It achieves better results than five state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-03-18T03:41:36Z)
• MIST-net: Multi-domain Integrative Swin Transformer network for Sparse-View CT Reconstruction [6.620837759518855]
  The sparse-view data reconstruction is one of typical underdetermined inverse problems. We propose a Multi-domain Integrative Swin Transformer network (MIST-net) The experiments on the numerical datasets with 48 views demonstrated our proposed MIST-net provided higher reconstructed image quality.
  arXiv  Detail & Related papers  (2021-11-28T14:43:26Z)
• Over-and-Under Complete Convolutional RNN for MRI Reconstruction [57.95363471940937]
  Recent deep learning-based methods for MR image reconstruction usually leverage a generic auto-encoder architecture. We propose an Over-and-Under Complete Convolu?tional Recurrent Neural Network (OUCR), which consists of an overcomplete and an undercomplete Convolutional Recurrent Neural Network(CRNN) The proposed method achieves significant improvements over the compressed sensing and popular deep learning-based methods with less number of trainable parameters.
  arXiv  Detail & Related papers  (2021-06-16T15:56:34Z)
• Multi-task MR Imaging with Iterative Teacher Forcing and Re-weighted Deep Learning [14.62432715967572]
  We develop a re-weighted multi-task deep learning method to learn prior knowledge from the existing big dataset. We then utilize them to assist simultaneous MR reconstruction and segmentation from the under-sampled k-space data. Results show that the proposed method possesses encouraging capabilities for simultaneous and accurate MR reconstruction and segmentation.
  arXiv  Detail & Related papers  (2020-11-27T09:08:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.