Joint Prediction of Meningioma Grade and Brain Invasion via Task-Aware
Contrastive Learning
- URL: http://arxiv.org/abs/2209.01517v1
- Date: Sun, 4 Sep 2022 02:50:47 GMT
- Title: Joint Prediction of Meningioma Grade and Brain Invasion via Task-Aware
Contrastive Learning
- Abstract summary: We propose a novel task-aware contrastive learning algorithm to jointly predict meningioma grade and brain invasion from multi-modal MRIs.
Based on the basic multi-task learning framework, our key idea is to adopt contrastive learning strategy to disentangle the image features into task-specific features and task-common features.
Experimental results show that the proposed algorithm outperforms alternative multi-task learning methods.
- Score: 27.87673051695757
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Preoperative and noninvasive prediction of the meningioma grade is important
in clinical practice, as it directly influences the clinical decision making.
What's more, brain invasion in meningioma (i.e., the presence of tumor tissue
within the adjacent brain tissue) is an independent criterion for the grading
of meningioma and influences the treatment strategy. Although efforts have been
reported to address these two tasks, most of them rely on hand-crafted features
and there is no attempt to exploit the two prediction tasks simultaneously. In
this paper, we propose a novel task-aware contrastive learning algorithm to
jointly predict meningioma grade and brain invasion from multi-modal MRIs.
Based on the basic multi-task learning framework, our key idea is to adopt
contrastive learning strategy to disentangle the image features into
task-specific features and task-common features, and explicitly leverage their
inherent connections to improve feature representation for the two prediction
tasks. In this retrospective study, an MRI dataset was collected, for which 800
patients (containing 148 high-grade, 62 invasion) were diagnosed with
meningioma by pathological analysis. Experimental results show that the
proposed algorithm outperforms alternative multi-task learning methods,
achieving AUCs of 0:8870 and 0:9787 for the prediction of meningioma grade and
brain invasion, respectively. The code is available at
https://github.com/IsDling/predictTCL.
Related papers
- Anatomy-R1: Enhancing Anatomy Reasoning in Multimodal Large Language Models via Anatomical Similarity Curriculum and Group Diversity Augmentation [52.7583577508452]
Multimodal Large Language Models (MLLMs) have achieved impressive progress in natural image reasoning.<n>Their potential in medical imaging remains underexplored, especially in clinical anatomical surgical images.<n>These challenges limit the effectiveness of conventionalSupervised Fine-Tuning strategies.
arXiv Detail & Related papers (2025-12-22T16:06:36Z) - NeuroABench: A Multimodal Evaluation Benchmark for Neurosurgical Anatomy Identification [56.133469598652624]
Multimodal Large Language Models (MLLMs) have shown significant potential in surgical video understanding.<n>Neurosurgical Anatomy Benchmark (NeuroABench) is first multimodal benchmark explicitly created to evaluate anatomical understanding in the neurosurgical domain.<n>NeuroABench consists of 9 hours of annotated neurosurgical videos covering 89 distinct procedures.
arXiv Detail & Related papers (2025-12-07T17:00:25Z) - Efficient Meningioma Tumor Segmentation Using Ensemble Learning [0.0]
Meningiomas represent the most prevalent form of primary brain tumors, comprising nearly one-third of all diagnosed cases.<n>Recent developments in deep learning have accelerated progress in automated tumor segmentation.<n>We propose a novel ensemble-based segmentation approach that combines three distinct architectures.
arXiv Detail & Related papers (2025-10-23T22:51:22Z) - Naturalistic Language-related Movie-Watching fMRI Task for Detecting Neurocognitive Decline and Disorder [60.84344168388442]
Language-related functional magnetic resonance imaging (fMRI) may be a promising approach for detecting cognitive decline and early NCD.<n>We examined the effectiveness of this task among 97 non-demented Chinese older adults from Hong Kong.<n>The study demonstrated the potential of the naturalistic language-related fMRI task for early detection of aging-related cognitive decline and NCD.
arXiv Detail & Related papers (2025-06-10T16:58:47Z) - Segmentation of Mental Foramen in Orthopantomographs: A Deep Learning Approach [1.9193578733126382]
This study aims to accelerate dental procedures, elevating patient care and healthcare efficiency in dentistry.
This research used Deep Learning methods to accurately detect and segment the Mental Foramen from panoramic radiograph images.
arXiv Detail & Related papers (2024-08-08T21:40:06Z) - Joint enhancement of automatic chest X-ray diagnosis and radiological gaze prediction with multi-stage cooperative learning [2.64700310378485]
We propose a novel deep learning framework for joint disease diagnosis and prediction of corresponding clinical visual attention maps for chest X-ray scans.
Specifically, we introduce a new dual-encoder multi-task UNet, which leverages both a DenseNet201 backbone and a Residual and Squeeze-and-Excitation block-based encoder.
Our proposed method is shown to significantly outperform existing techniques for chest X-ray diagnosis and the quality of visual attention map prediction.
arXiv Detail & Related papers (2024-03-25T17:31:12Z) - UniBrain: Universal Brain MRI Diagnosis with Hierarchical
Knowledge-enhanced Pre-training [66.16134293168535]
We propose a hierarchical knowledge-enhanced pre-training framework for the universal brain MRI diagnosis, termed as UniBrain.
Specifically, UniBrain leverages a large-scale dataset of 24,770 imaging-report pairs from routine diagnostics.
arXiv Detail & Related papers (2023-09-13T09:22:49Z) - Prediction of brain tumor recurrence location based on multi-modal
fusion and nonlinear correlation learning [55.789874096142285]
We present a deep learning-based brain tumor recurrence location prediction network.
We first train a multi-modal brain tumor segmentation network on the public dataset BraTS 2021.
Then, the pre-trained encoder is transferred to our private dataset for extracting the rich semantic features.
Two decoders are constructed to jointly segment the present brain tumor and predict its future tumor recurrence location.
arXiv Detail & Related papers (2023-04-11T02:45:38Z) - A Novel Supervised Contrastive Regression Framework for Prediction of
Neurocognitive Measures Using Multi-Site Harmonized Diffusion MRI
Tractography [13.80649748804573]
Supervised Contrastive Regression (SCR) is a simple yet effective method that allows full supervision for contrastive learning in regression tasks.
SCR performs supervised contrastive representation learning by using the absolute difference between continuous regression labels.
SCR improves the accuracy of neurocognitive score prediction compared to other state-of-the-art methods.
arXiv Detail & Related papers (2022-10-13T23:24:12Z) - MRI-based Multi-task Decoupling Learning for Alzheimer's Disease
Detection and MMSE Score Prediction: A Multi-site Validation [9.427540028148963]
Accurately detecting Alzheimer's disease (AD) and predicting mini-mental state examination (MMSE) score are important tasks in elderly health by magnetic resonance imaging (MRI)
Most of the previous methods on these two tasks are based on single-task learning and rarely consider the correlation between them.
We propose a MRI-based multi-task decoupled learning method for AD detection and MMSE score prediction.
arXiv Detail & Related papers (2022-04-02T09:19:18Z) - EMT-NET: Efficient multitask network for computer-aided diagnosis of
breast cancer [58.720142291102135]
We propose an efficient and light-weighted learning architecture to classify and segment breast tumors simultaneously.
We incorporate a segmentation task into a tumor classification network, which makes the backbone network learn representations focused on tumor regions.
The accuracy, sensitivity, and specificity of tumor classification is 88.6%, 94.1%, and 85.3%, respectively.
arXiv Detail & Related papers (2022-01-13T05:24:40Z) - Learning Personal Representations from fMRIby Predicting Neurofeedback
Performance [52.77024349608834]
We present a deep neural network method for learning a personal representation for individuals performing a self neuromodulation task, guided by functional MRI (fMRI)
The representation is learned by a self-supervised recurrent neural network, that predicts the Amygdala activity in the next fMRI frame given recent fMRI frames and is conditioned on the learned individual representation.
arXiv Detail & Related papers (2021-12-06T10:16:54Z) - MIMO: Mutual Integration of Patient Journey and Medical Ontology for
Healthcare Representation Learning [49.57261599776167]
We propose an end-to-end robust Transformer-based solution, Mutual Integration of patient journey and Medical Ontology (MIMO) for healthcare representation learning and predictive analytics.
arXiv Detail & Related papers (2021-07-20T07:04:52Z) - Modality-Pairing Learning for Brain Tumor Segmentation [34.58078431696929]
We propose a novel end-to-end Modality-Pairing learning method for brain tumor segmentation.
Our method is tested on the BraTS 2020 online testing dataset, obtaining promising segmentation performance.
arXiv Detail & Related papers (2020-10-19T07:42:10Z) - Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge [53.48285637256203]
iSeg 2019 challenge provides a set of 6-month infant subjects from multiple sites with different protocols/scanners for the participating methods.
By the time of writing, there are 30 automatic segmentation methods participating in iSeg 2019.
We review the 8 top-ranked teams by detailing their pipelines/implementations, presenting experimental results and evaluating performance in terms of the whole brain, regions of interest, and gyral landmark curves.
arXiv Detail & Related papers (2020-07-04T13:39:48Z) - Mapping individual differences in cortical architecture using multi-view
representation learning [0.0]
We introduce a novel machine learning method which allows combining the activation-and connectivity-based information respectively measured through task-fMRI and resting-state fMRI.
It combines a multi-view deep autoencoder which is designed to fuse the two fMRI modalities into a joint representation space within which a predictive model is trained to guess a scalar score that characterizes the patient.
arXiv Detail & Related papers (2020-04-01T09:01:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.