Dual Meta-Learning with Longitudinally Generalized Regularization for
One-Shot Brain Tissue Segmentation Across the Human Lifespan
- URL: http://arxiv.org/abs/2308.06774v1
- Date: Sun, 13 Aug 2023 14:02:27 GMT
- Title: Dual Meta-Learning with Longitudinally Generalized Regularization for
One-Shot Brain Tissue Segmentation Across the Human Lifespan
- Authors: Yongheng Sun, Fan Wang, Jun Shu, Haifeng Wang, Li Wang. Deyu Meng,
Chunfeng Lian
- Abstract summary: We propose a dual meta-learning paradigm to learn longitudinally consistent representations and persist when fine-tuning.
Specifically, we learn a plug-and-play feature extractor to extract longitudinal-consistent anatomical representations.
Experimental results on the iSeg 2019 and ADNI datasets demonstrate the effectiveness of our method.
- Score: 30.57799149219082
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Brain tissue segmentation is essential for neuroscience and clinical studies.
However, segmentation on longitudinal data is challenging due to dynamic brain
changes across the lifespan. Previous researches mainly focus on
self-supervision with regularizations and will lose longitudinal generalization
when fine-tuning on a specific age group. In this paper, we propose a dual
meta-learning paradigm to learn longitudinally consistent representations and
persist when fine-tuning. Specifically, we learn a plug-and-play feature
extractor to extract longitudinal-consistent anatomical representations by
meta-feature learning and a well-initialized task head for fine-tuning by
meta-initialization learning. Besides, two class-aware regularizations are
proposed to encourage longitudinal consistency. Experimental results on the
iSeg2019 and ADNI datasets demonstrate the effectiveness of our method. Our
code is available at https://github.com/ladderlab-xjtu/DuMeta.
Related papers
- DuMeta++: Spatiotemporal Dual Meta-Learning for Generalizable Few-Shot Brain Tissue Segmentation Across Diverse Ages [14.361008329377498]
We propose emphDuMeta++, a dual meta-learning framework that operates without paired longitudinal data.<n>Our approach integrates: (1) meta-feature learning to extract age-agnostic semantic representations of brain structures, and (2) meta-initialization learning to enable data-efficient adaptation of the segmentation model.
arXiv Detail & Related papers (2026-02-06T20:21:19Z) - Rewiring Development in Brain Segmentation: Leveraging Adult Brain Priors for Enhancing Infant MRI Segmentation [0.14777718769290524]
We present LODi, a novel framework that utilizes prior knowledge from an adult brain MRI segmentation model to enhance the segmentation performance of infant scans.<n>Our findings highlight the advantage of leveraging adult brain priors as a foundation for age-flexible neuroimaging analysis, paving the way for more reliable and generalizable brain MRI segmentation across the lifespan.
arXiv Detail & Related papers (2025-10-10T11:55:43Z) - Knowledge-Guided Prompt Learning for Lifespan Brain MR Image Segmentation [53.70131202548981]
We present a two-step segmentation framework employing Knowledge-Guided Prompt Learning (KGPL) for brain MRI.
Specifically, we first pre-train segmentation models on large-scale datasets with sub-optimal labels.
The introduction of knowledge-wise prompts captures semantic relationships between anatomical variability and biological processes.
arXiv Detail & Related papers (2024-07-31T04:32:43Z) - Predicting Infant Brain Connectivity with Federated Multi-Trajectory
GNNs using Scarce Data [54.55126643084341]
Existing deep learning solutions suffer from three major limitations.
We introduce FedGmTE-Net++, a federated graph-based multi-trajectory evolution network.
Using the power of federation, we aggregate local learnings among diverse hospitals with limited datasets.
arXiv Detail & Related papers (2024-01-01T10:20:01Z) - MAP: Domain Generalization via Meta-Learning on Anatomy-Consistent
Pseudo-Modalities [12.194439938007672]
We propose Meta learning on Anatomy-consistent Pseudo-modalities (MAP)
MAP improves model generalizability by learning structural features.
We evaluate our model on seven public datasets of various retinal imaging modalities.
arXiv Detail & Related papers (2023-09-03T22:56:22Z) - Continual Learning for Abdominal Multi-Organ and Tumor Segmentation [15.983529525062938]
We propose an innovative architecture designed specifically for continuous organ and tumor segmentation.
Our proposed design involves replacing the conventional output layer with a suite of lightweight, class-specific heads.
These heads enable independent predictions for newly introduced and previously learned classes, effectively minimizing the impact of new classes on old ones.
arXiv Detail & Related papers (2023-06-01T17:59:57Z) - Learning from partially labeled data for multi-organ and tumor
segmentation [102.55303521877933]
We propose a Transformer based dynamic on-demand network (TransDoDNet) that learns to segment organs and tumors on multiple datasets.
A dynamic head enables the network to accomplish multiple segmentation tasks flexibly.
We create a large-scale partially labeled Multi-Organ and Tumor benchmark, termed MOTS, and demonstrate the superior performance of our TransDoDNet over other competitors.
arXiv Detail & Related papers (2022-11-13T13:03:09Z) - Longitudinal detection of new MS lesions using Deep Learning [0.0]
We describe a deep-learning-based pipeline addressing the task of detecting and segmenting new MS lesions.
First, we propose to use transfer-learning from a model trained on a segmentation task using single time-points.
Second, we propose a data synthesis strategy to generate realistic longitudinal time-points with new lesions.
arXiv Detail & Related papers (2022-06-16T16:09:04Z) - Generalized Organ Segmentation by Imitating One-shot Reasoning using
Anatomical Correlation [55.1248480381153]
We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes.
We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
arXiv Detail & Related papers (2021-03-30T13:41:12Z) - Self-Supervised Longitudinal Neighbourhood Embedding [13.633165258766418]
We propose a self-supervised strategy for representation learning named Longitudinal Neighborhood Embedding.
Motivated by concepts in contrastive learning, LNE explicitly models the similarity between trajectory vectors across different subjects.
We apply LNE to longitudinal T1w MRIs of two neuroimaging studies: a dataset composed of 274 healthy subjects, and Alzheimer's Disease Neuroimaging Initiative.
arXiv Detail & Related papers (2021-03-05T17:55:53Z) - Towards Cross-modality Medical Image Segmentation with Online Mutual
Knowledge Distillation [71.89867233426597]
In this paper, we aim to exploit the prior knowledge learned from one modality to improve the segmentation performance on another modality.
We propose a novel Mutual Knowledge Distillation scheme to thoroughly exploit the modality-shared knowledge.
Experimental results on the public multi-class cardiac segmentation data, i.e., MMWHS 2017, show that our method achieves large improvements on CT segmentation.
arXiv Detail & Related papers (2020-10-04T10:25:13Z) - Sparse Graphical Memory for Robust Planning [93.39298821537197]
We introduce Sparse Graphical Memory (SGM), a new data structure that stores states and feasible transitions in a sparse memory.
SGM aggregates states according to a novel two-way consistency objective, adapting classic state aggregation criteria to goal-conditioned RL.
We show that SGM significantly outperforms current state of the art methods on long horizon, sparse-reward visual navigation tasks.
arXiv Detail & Related papers (2020-03-13T17:59:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.