Multicentric thrombus segmentation using an attention-based recurrent network with gradual modality dropout
- URL: http://arxiv.org/abs/2604.00817v1
- Date: Wed, 01 Apr 2026 12:25:00 GMT
- Title: Multicentric thrombus segmentation using an attention-based recurrent network with gradual modality dropout
- Abstract summary: We introduce a methodology that couples an attention-based recurrent segmentation network (UpAttLLSTM)<n>UpAttLLSTM aggregates context across slices via recurrent units (2.5D) and uses attention gates to fuse complementary cues across available sequences.<n>On a monocentric cohort, our approach detects thrombi in >90% of cases with a Dice score of 0.65.<n>In a multi-center setting with missing modalities, it achieves-80% detection with a Dice score around 0.35.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Detecting and delineating tiny targets in 3D brain scans is a central yet under-addressed challenge in medical imaging.In ischemic stroke, for instance, the culprit thrombus is small, low-contrast, and variably expressed across modalities(e.g., susceptibility-weighted T2 blooming, diffusion restriction on DWI/ADC), while real-world multi-center dataintroduce domain shifts, anisotropy, and frequent missing sequences. We introduce a methodology that couples an attention-based recurrent segmentation network (UpAttLLSTM), a training schedule that progressively increases the difficulty of hetero-modal learning, with gradual modality dropout, UpAttLLSTM aggregates context across slices via recurrent units (2.5D) and uses attention gates to fuse complementary cues across available sequences, making it robust to anisotropy and class imbalance. Gradual modality dropout systematically simulates site heterogeneity,noise, and missing modalities during training, acting as both augmentation and regularization to improve multi-center generalization. On a monocentric cohort, our approach detects thrombi in >90% of cases with a Dice score of 0.65. In a multi-center setting with missing modalities, it achieves-80% detection with a Dice score around 0.35. Beyond stroke, the proposed methodology directly transfers to other small-lesion tasks in 3D medical imaging where targets are scarce, subtle, and modality-dependent
Related papers
- Intracranial Aneurysm Classification and Segmentation via Tri-Axial ROI and Multi-Task Learning [22.134113900302967]
Intracranial aneurysms are often asymptomatic until rupture, which carries high mortality.<n>We present a multi-task framework that simultaneously performs multi-label classification, multi-class aneurysm segmentation, and multi-class vessel segmentation.<n>Our two-fold ensemble achieved 2nd place in the RSNA 2025 Intracranial Aneurysm Detection challenge.
arXiv Detail & Related papers (2026-06-25T07:35:06Z) - D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities [54.87947751720332]
We propose a novel segmentation model D3Seg to maintain stable performance under missing-modality settings.<n>The proposed model achieves approximately 1.5-2.0% Dice improvement on enhancing tumor (ET) and around 1.0% on tumor core (TC) across multiple missing modality configurations.
arXiv Detail & Related papers (2026-05-21T09:55:42Z) - Degradation-Aware Blur-Segmentation of Brain Tumor [6.772154747032075]
Degradation-Aware Blur-Segmentation Net (DABSeg) is a synchronous deblurring 3D multimodal MRI segmentation network.<n>We propose a feature-domain motion-deblurring stem to compensate for blur and rebalance intensity.<n>System embeds a blur-aware cross-modal cross-attention module and multi-scale residual aggregation to yield effective modality complementarity.
arXiv Detail & Related papers (2026-05-15T06:47:37Z) - Beyond Instance-Level Self-Supervision in 3D Multi-Modal Medical Imaging [29.556385532527752]
Self-supervised pre-training methods in medical imaging typically treat each individual as an isolated instance.<n>We propose leveraging this cross-instance topological consistency as a supervisory signal.<n>We validate our approach across 7 downstream multi-modal tasks, achieving average improvements of 1.1% and 5.94% in segmentation and classification tasks.
arXiv Detail & Related papers (2026-05-14T10:10:34Z) - UniField: A Unified Field-Aware MRI Enhancement Framework [45.03230466428695]
methodname is a unified framework integrating multiple modalities and enhancement tasks.<n>We exploit comprehensive 3D volumetric information by leveraging pre-trained 3D foundation models.<n>We organize and publicly release a comprehensive paired multi-field MRI dataset.
arXiv Detail & Related papers (2026-03-10T05:45:12Z) - PF-DAformer: Proximal Femur Segmentation via Domain Adaptive Transformer for Dual-Center QCT [8.358409792893278]
We develop a domain-adaptive transformer segmentation framework tailored for multi-institutional Quantitative computed tomography (QCT)<n>Our model is trained and validated on one of the largest hip fracture related research cohorts to date, comprising 1,024 QCT images scans from Tulane University and 384 scans from Rochester, Minnesota for proximal femur segmentation.
arXiv Detail & Related papers (2025-10-30T18:07:56Z) - Learning from Heterogeneous Structural MRI via Collaborative Domain Adaptation for Late-Life Depression Assessment [24.340328016766183]
We propose a Collaborative Domain Adaptation framework for LLD detection using T1-weighted MRIs.<n>The framework consists of three stages: supervised training on labeled source data, self-supervised target feature adaptation and collaborative training on unlabeled target data.<n>Experiments conducted on multi-site T1-weighted MRI data demonstrate that the framework consistently outperforms state-of-the-art unsupervised domain adaptation methods.
arXiv Detail & Related papers (2025-07-30T01:38:32Z) - Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasound [40.97115667616978]
We introduce a novel learning-based WSS framework called Flip Learning, which relies solely on 2D/3D boxes for accurate segmentation.<n>Multiple agents are employed to erase the target from the box to facilitate classification tag flipping, with the erased region serving as the predicted segmentation mask.<n>Our method outperforms state-of-the-art WSS methods and foundation models, and achieves comparable performance as fully-supervised learning algorithms.
arXiv Detail & Related papers (2025-03-26T16:20:02Z) - GS-EMA: Integrating Gradient Surgery Exponential Moving Average with
Boundary-Aware Contrastive Learning for Enhanced Domain Generalization in
Aneurysm Segmentation [41.97669338211682]
We propose a novel domain generalization strategy that employs gradient surgery exponential moving average (GS-EMA) optimization technique and boundary-aware contrastive learning (BACL)
Our approach is distinct in its ability to adapt to new, unseen domains by learning domain-invariant features, thereby improving the robustness and accuracy of aneurysm segmentation across diverse clinical datasets.
arXiv Detail & Related papers (2024-02-23T10:02:15Z) - MMA-RNN: A Multi-level Multi-task Attention-based Recurrent Neural
Network for Discrimination and Localization of Atrial Fibrillation [1.8037893225125925]
This paper proposes the Multi-level Multi-task Attention-based Recurrent Neural Network for three-class discrimination on patients and localization of the exact timing of AF episodes.
The model is designed as an end-to-end framework to enhance information interaction and reduce error accumulation.
arXiv Detail & Related papers (2023-02-07T19:59:55Z) - Supervised Contrastive Learning to Classify Paranasal Anomalies in the
Maxillary Sinus [43.850343556811275]
Using deep learning techniques, anomalies in the paranasal sinus system can be detected automatically in MRI images.
Existing deep learning methods in paranasal anomaly classification have been used to diagnose at most one anomaly.
We propose a novel learning paradigm that combines contrastive loss and cross-entropy loss.
arXiv Detail & Related papers (2022-09-05T12:31:28Z) - Cross-Site Severity Assessment of COVID-19 from CT Images via Domain
Adaptation [64.59521853145368]
Early and accurate severity assessment of Coronavirus disease 2019 (COVID-19) based on computed tomography (CT) images offers a great help to the estimation of intensive care unit event.
To augment the labeled data and improve the generalization ability of the classification model, it is necessary to aggregate data from multiple sites.
This task faces several challenges including class imbalance between mild and severe infections, domain distribution discrepancy between sites, and presence of heterogeneous features.
arXiv Detail & Related papers (2021-09-08T07:56:51Z) - Cross-Modality Brain Tumor Segmentation via Bidirectional
Global-to-Local Unsupervised Domain Adaptation [61.01704175938995]
In this paper, we propose a novel Bidirectional Global-to-Local (BiGL) adaptation framework under a UDA scheme.
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor.
The proposed method outperforms several state-of-the-art unsupervised domain adaptation methods by a large margin.
arXiv Detail & Related papers (2021-05-17T10:11:45Z) - SCPM-Net: An Anchor-free 3D Lung Nodule Detection Network using Sphere
Representation and Center Points Matching [47.79483848496141]
We propose a 3D sphere representation-based center-points matching detection network (SCPM-Net)
It is anchor-free and automatically predicts the position, radius, and offset of nodules without the manual design of nodule/anchor parameters.
We show that our proposed SCPM-Net framework achieves superior performance compared with existing used anchor-based and anchor-free methods for lung nodule detection.
arXiv Detail & Related papers (2021-04-12T05:51:29Z) - An anatomically-informed 3D CNN for brain aneurysm classification with
weak labels [0.2010294990327175]
We address the task of brain aneurysm detection as a patch-wise binary classification with weak labels.
Our approach comes with the non-trivial challenge of the data set creation.
We propose a novel, anatomically-driven approach by using a multi-scale and multi-input 3D Convolutional Neural Network.
arXiv Detail & Related papers (2020-11-27T08:00:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.