Transferable Optimization Network for Cross-Domain Image Reconstruction

• URL: http://arxiv.org/abs/2603.07831v1
• Date: Sun, 08 Mar 2026 22:20:03 GMT
• Title: Transferable Optimization Network for Cross-Domain Image Reconstruction
• Abstract summary: We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems.<n>In the first step, we train a powerful universal feature-extractor that is capable of learning important knowledge from large, heterogeneous data sets.<n>In the second step, we train a task-specific domain-adapter for a new target domain or task with only a limited amount of data available for training.
• Score: 1.4929298667651638
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In the first step, we train a powerful universal feature-extractor that is capable of learning important knowledge from large, heterogeneous data sets in various domains. In the second step, we train a task-specific domain-adapter for a new target domain or task with only a limited amount of data available for training. Then the composition of the adapter and the universal feature-extractor effectively explores feature which serve as an important component of image regularization for the new domains, and this leads to high-quality reconstruction despite the data limitation issue. We apply this framework to reconstruct under-sampled MR images with limited data by using a collection of diverse data samples from different domains, such as images of other anatomies, measurements of various sampling ratios, and even different image modalities, including natural images. Experimental results demonstrate a promising transfer learning capability of the proposed method.

Related papers

• An Adaptive, Disentangled Representation for Multidimensional MRI Reconstruction [3.3803617991341053]
  We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data.<n>Our method builds on a novel, learned feature-based image representation that disentangles different types of features, such as geometry and contrast, into distinct low-dimensional latent spaces.<n>New reconstruction formulations and algorithms were developed to integrate the learned representation with a zero-shot selfsupervised learning adaptation and subspace modeling.
  arXiv  Detail & Related papers  (2025-12-31T07:02:21Z)
• Cross-Domain Few-Shot Learning via Multi-View Collaborative Optimization with Vision-Language Models [37.63573703440172]
  Vision-language models (VLMs) pre-trained on natural image and language data, such as CLIP, have exhibited significant potential in few-shot image recognition tasks.<n>We propose Consistency-guided Multi-view Collaborative Optimization (CoMuCo), a novel fine-tuning strategy for VLMs.
  arXiv  Detail & Related papers  (2025-08-18T12:00:09Z)
• Retrieval-guided Cross-view Image Synthesis [3.7477511412024573]
  Cross-view image synthesis presents significant challenges in establishing reliable correspondences.<n>We propose a retrieval-guided framework that reimagines how retrieval techniques can facilitate effective cross-view image synthesis.<n>Our work bridges information retrieval and synthesis tasks, offering insights into how retrieval techniques can address complex cross-domain synthesis challenges.
  arXiv  Detail & Related papers  (2024-11-29T07:04:44Z)
• Unity in Diversity: Multi-expert Knowledge Confrontation and Collaboration for Generalizable Vehicle Re-identification [60.20318058777603]
  Generalizable vehicle re-identification (ReID) seeks to develop models that can adapt to unknown target domains without the need for fine-tuning or retraining.<n>Previous works have mainly focused on extracting domain-invariant features by aligning data distributions between source domains.<n>We propose a two-stage Multi-expert Knowledge Confrontation and Collaboration (MiKeCoCo) method to solve this unique problem.
  arXiv  Detail & Related papers  (2024-07-10T04:06:39Z)
• Cross-domain and Cross-dimension Learning for Image-to-Graph Transformers [48.74331852418905]
  Direct image-to-graph transformation is a challenging task that involves solving object detection and relationship prediction in a single model.<n>Due to this task's complexity, large training datasets are rare in many domains, making the training of deep-learning methods challenging.<n>We introduce a set of methods enabling cross-domain and cross-dimension learning for image-to-graph transformers.
  arXiv  Detail & Related papers  (2024-03-11T10:48:56Z)
• Unsupervised Domain Transfer with Conditional Invertible Neural Networks [83.90291882730925]
  We propose a domain transfer approach based on conditional invertible neural networks (cINNs) Our method inherently guarantees cycle consistency through its invertible architecture, and network training can efficiently be conducted with maximum likelihood. Our method enables the generation of realistic spectral data and outperforms the state of the art on two downstream classification tasks.
  arXiv  Detail & Related papers  (2023-03-17T18:00:27Z)
• Data Instance Prior for Transfer Learning in GANs [25.062518859107946]
  We propose a novel transfer learning method for GANs in the limited data domain. We show that the proposed method effectively transfers knowledge to domains with few target images. We also show the utility of data instance prior in large-scale unconditional image generation and image editing tasks.
  arXiv  Detail & Related papers  (2020-12-08T07:40:30Z)
• DoFE: Domain-oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets [96.92018649136217]
  We present a novel Domain-oriented Feature Embedding (DoFE) framework to improve the generalization ability of CNNs on unseen target domains. Our DoFE framework dynamically enriches the image features with additional domain prior knowledge learned from multi-source domains. Our framework generates satisfying segmentation results on unseen datasets and surpasses other domain generalization and network regularization methods.
  arXiv  Detail & Related papers  (2020-10-13T07:28:39Z)
• Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond [62.730497582218284]
  We develop a new deep learning based framework to optimize a diffeomorphic model via multi-scale propagation. We conduct two groups of image registration experiments on 3D volume datasets including image-to-atlas registration on brain MRI data and image-to-image registration on liver CT data.
  arXiv  Detail & Related papers  (2020-04-30T03:23:45Z)
• Two-shot Spatially-varying BRDF and Shape Estimation [89.29020624201708]
  We propose a novel deep learning architecture with a stage-wise estimation of shape and SVBRDF. We create a large-scale synthetic training dataset with domain-randomized geometry and realistic materials. Experiments on both synthetic and real-world datasets show that our network trained on a synthetic dataset can generalize well to real-world images.
  arXiv  Detail & Related papers  (2020-04-01T12:56:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.