One-shot Joint Extraction, Registration and Segmentation of Neuroimaging
Data
- URL: http://arxiv.org/abs/2307.15198v1
- Date: Thu, 27 Jul 2023 21:14:40 GMT
- Title: One-shot Joint Extraction, Registration and Segmentation of Neuroimaging
Data
- Authors: Yao Su and Zhentian Qian and Lei Ma and Lifang He and Xiangnan Kong
- Abstract summary: We propose a unified end-to-end framework, called JERS, to jointly optimize the extraction, registration and segmentation tasks.
Our proposed method performs exceptionally in the extraction, registration and segmentation tasks.
- Score: 20.2926956400118
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Brain extraction, registration and segmentation are indispensable
preprocessing steps in neuroimaging studies. The aim is to extract the brain
from raw imaging scans (i.e., extraction step), align it with a target brain
image (i.e., registration step) and label the anatomical brain regions (i.e.,
segmentation step). Conventional studies typically focus on developing separate
methods for the extraction, registration and segmentation tasks in a supervised
setting. The performance of these methods is largely contingent on the quantity
of training samples and the extent of visual inspections carried out by experts
for error correction. Nevertheless, collecting voxel-level labels and
performing manual quality control on high-dimensional neuroimages (e.g., 3D
MRI) are expensive and time-consuming in many medical studies. In this paper,
we study the problem of one-shot joint extraction, registration and
segmentation in neuroimaging data, which exploits only one labeled template
image (a.k.a. atlas) and a few unlabeled raw images for training. We propose a
unified end-to-end framework, called JERS, to jointly optimize the extraction,
registration and segmentation tasks, allowing feedback among them.
Specifically, we use a group of extraction, registration and segmentation
modules to learn the extraction mask, transformation and segmentation mask,
where modules are interconnected and mutually reinforced by self-supervision.
Empirical results on real-world datasets demonstrate that our proposed method
performs exceptionally in the extraction, registration and segmentation tasks.
Our code and data can be found at https://github.com/Anonymous4545/JERS
Related papers
- Distillation Learning Guided by Image Reconstruction for One-Shot Medical Image Segmentation [12.33442990188044]
One-shot medical image segmentation (MIS) methods often struggle with registration errors and low-quality synthetic images.
We introduce a novel one-shot MIS framework based on knowledge distillation.
It allows the network to directly'see' real images through a distillation process guided by image reconstruction.
arXiv Detail & Related papers (2024-08-07T08:17:34Z) - Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement
Learning [53.00683059396803]
Mask image model (MIM) has been widely used due to its simplicity and effectiveness in recovering original information from masked images.
We propose a decision-based MIM that utilizes reinforcement learning (RL) to automatically search for optimal image masking ratio and masking strategy.
Our approach has a significant advantage over alternative self-supervised methods on the task of neuron segmentation.
arXiv Detail & Related papers (2023-10-06T10:40:46Z) - Unsupervised Segmentation of Fetal Brain MRI using Deep Learning
Cascaded Registration [2.494736313545503]
Traditional deep learning-based automatic segmentation requires extensive training data with ground-truth labels.
We propose a novel method based on multi-atlas segmentation, that accurately segments multiple tissues without relying on labeled data for training.
Our method employs a cascaded deep learning network for 3D image registration, which computes small, incremental deformations to the moving image to align it precisely with the fixed image.
arXiv Detail & Related papers (2023-07-07T13:17:12Z) - Collaborative Feature Learning for Fine-grained Facial Forgery Detection
and Segmentation [56.73855202368894]
Previous work related to forgery detection mostly focuses on the entire faces.
Recent forgery methods have developed to edit important facial components while maintaining others unchanged.
We propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components.
arXiv Detail & Related papers (2023-04-17T08:49:11Z) - Self-Supervised Correction Learning for Semi-Supervised Biomedical Image
Segmentation [84.58210297703714]
We propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation.
We design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting.
Experiments on three medical image segmentation datasets for different tasks demonstrate the outstanding performance of our method.
arXiv Detail & Related papers (2023-01-12T08:19:46Z) - ERNet: Unsupervised Collective Extraction and Registration in
Neuroimaging Data [19.691653910323566]
We propose a unified end-to-end framework, called ERNet, to jointly optimize the extraction and registration tasks.
Experiment results show that our proposed method can effectively improve the performance on extraction and registration tasks in neuroimaging data.
arXiv Detail & Related papers (2022-12-06T20:12:54Z) - Mixed-UNet: Refined Class Activation Mapping for Weakly-Supervised
Semantic Segmentation with Multi-scale Inference [28.409679398886304]
We develop a novel model named Mixed-UNet, which has two parallel branches in the decoding phase.
We evaluate the designed Mixed-UNet against several prevalent deep learning-based segmentation approaches on our dataset collected from the local hospital and public datasets.
arXiv Detail & Related papers (2022-05-06T08:37:02Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - Towards Robust Partially Supervised Multi-Structure Medical Image
Segmentation on Small-Scale Data [123.03252888189546]
We propose Vicinal Labels Under Uncertainty (VLUU) to bridge the methodological gaps in partially supervised learning (PSL) under data scarcity.
Motivated by multi-task learning and vicinal risk minimization, VLUU transforms the partially supervised problem into a fully supervised problem by generating vicinal labels.
Our research suggests a new research direction in label-efficient deep learning with partial supervision.
arXiv Detail & Related papers (2020-11-28T16:31:00Z) - JSSR: A Joint Synthesis, Segmentation, and Registration System for 3D
Multi-Modal Image Alignment of Large-scale Pathological CT Scans [27.180136688977512]
We propose a novel multi-task learning system, JSSR, based on an end-to-end 3D convolutional neural network.
The system is optimized to satisfy the implicit constraints between different tasks in an unsupervised manner.
It consistently outperforms conventional state-of-the-art multi-modal registration methods.
arXiv Detail & Related papers (2020-05-25T16:30:02Z) - 3D medical image segmentation with labeled and unlabeled data using
autoencoders at the example of liver segmentation in CT images [58.720142291102135]
This work investigates the potential of autoencoder-extracted features to improve segmentation with a convolutional neural network.
A convolutional autoencoder was used to extract features from unlabeled data and a multi-scale, fully convolutional CNN was used to perform the target task of 3D liver segmentation in CT images.
arXiv Detail & Related papers (2020-03-17T20:20:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.