MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination
of Multi-Sequence CMR Images
- URL: http://arxiv.org/abs/2211.03062v1
- Date: Sun, 6 Nov 2022 08:46:24 GMT
- Title: MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination
of Multi-Sequence CMR Images
- Authors: Junyi Qiu, Lei Li, Sihan Wang, Ke Zhang, Yinyin Chen, Shan Yang,
Xiahai Zhuang
- Abstract summary: We develop an end-to-end deep neural network, referred to as MyoPS-Net, to flexibly combine five-sequence cardiac magnetic resonance (CMR) images for MyoPS.
To extract precise and adequate information, we design an effective yet flexible architecture to extract and fuse cross-modal features.
Results proved the superiority and generalizability of MyoPS-Net, and more importantly, indicated a practical clinical application.
- Score: 21.671773978257253
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Myocardial pathology segmentation (MyoPS) can be a prerequisite for the
accurate diagnosis and treatment planning of myocardial infarction. However,
achieving this segmentation is challenging, mainly due to the inadequate and
indistinct information from an image. In this work, we develop an end-to-end
deep neural network, referred to as MyoPS-Net, to flexibly combine
five-sequence cardiac magnetic resonance (CMR) images for MyoPS. To extract
precise and adequate information, we design an effective yet flexible
architecture to extract and fuse cross-modal features. This architecture can
tackle different numbers of CMR images and complex combinations of modalities,
with output branches targeting specific pathologies. To impose anatomical
knowledge on the segmentation results, we first propose a module to regularize
myocardium consistency and localize the pathologies, and then introduce an
inclusiveness loss to utilize relations between myocardial scars and edema. We
evaluated the proposed MyoPS-Net on two datasets, i.e., a private one
consisting of 50 paired multi-sequence CMR images and a public one from
MICCAI2020 MyoPS Challenge. Experimental results showed that MyoPS-Net could
achieve state-of-the-art performance in various scenarios. Note that in
practical clinics, the subjects may not have full sequences, such as missing
LGE CMR or mapping CMR scans. We therefore conducted extensive experiments to
investigate the performance of the proposed method in dealing with such complex
combinations of different CMR sequences. Results proved the superiority and
generalizability of MyoPS-Net, and more importantly, indicated a practical
clinical application.
Related papers
- K-Space-Aware Cross-Modality Score for Synthesized Neuroimage Quality
Assessment [71.27193056354741]
The problem of how to assess cross-modality medical image synthesis has been largely unexplored.
We propose a new metric K-CROSS to spur progress on this challenging problem.
K-CROSS uses a pre-trained multi-modality segmentation network to predict the lesion location.
arXiv Detail & Related papers (2023-07-10T01:26:48Z) - Aligning Multi-Sequence CMR Towards Fully Automated Myocardial Pathology
Segmentation [20.68539814306763]
Myocardial pathology segmentation (MyoPS) is critical for the risk stratification and treatment planning of myocardial infarction (MI)
This work presents an automatic MyoPS framework for unaligned MS-CMR images.
arXiv Detail & Related papers (2023-02-07T15:41:40Z) - AWSnet: An Auto-weighted Supervision Attention Network for Myocardial
Scar and Edema Segmentation in Multi-sequence Cardiac Magnetic Resonance
Images [23.212429566838203]
We develop a novel auto-weighted supervision framework to tackle the scar and edema segmentation from multi-sequence CMR data.
We also design a coarse-to-fine framework to boost the small myocardial pathology region segmentation with shape prior knowledge.
Our method is promising in advancing the myocardial pathology assessment on multi-sequence CMR data.
arXiv Detail & Related papers (2022-01-14T08:59:54Z) - MyoPS: A Benchmark of Myocardial Pathology Segmentation Combining
Three-Sequence Cardiac Magnetic Resonance Images [84.02849948202116]
This work defines a new task of medical image analysis, i.e., to perform myocardial pathology segmentation (MyoPS)
MyoPS combines three-sequence cardiac magnetic resonance (CMR) images, which was first proposed in the MyoPS challenge, in conjunction with MICCAI 2020.
The challenge provided 45 paired and pre-aligned CMR images, allowing algorithms to combine the complementary information from the three CMR sequences for pathology segmentation.
arXiv Detail & Related papers (2022-01-10T06:37:23Z) - Modality Completion via Gaussian Process Prior Variational Autoencoders
for Multi-Modal Glioma Segmentation [75.58395328700821]
We propose a novel model, Multi-modal Gaussian Process Prior Variational Autoencoder (MGP-VAE), to impute one or more missing sub-modalities for a patient scan.
MGP-VAE can leverage the Gaussian Process (GP) prior on the Variational Autoencoder (VAE) to utilize the subjects/patients and sub-modalities correlations.
We show the applicability of MGP-VAE on brain tumor segmentation where either, two, or three of four sub-modalities may be missing.
arXiv Detail & Related papers (2021-07-07T19:06:34Z) - Few-shot Medical Image Segmentation using a Global Correlation Network
with Discriminative Embedding [60.89561661441736]
We propose a novel method for few-shot medical image segmentation.
We construct our few-shot image segmentor using a deep convolutional network trained episodically.
We enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class.
arXiv Detail & Related papers (2020-12-10T04:01:07Z) - Max-Fusion U-Net for Multi-Modal Pathology Segmentation with Attention
and Dynamic Resampling [13.542898009730804]
The performance of relevant algorithms is significantly affected by the proper fusion of the multi-modal information.
We present the Max-Fusion U-Net that achieves improved pathology segmentation performance.
We evaluate our methods using the Myocardial pathology segmentation (MyoPS) combining the multi-sequence CMR dataset.
arXiv Detail & Related papers (2020-09-05T17:24:23Z) - Multi-Modality Pathology Segmentation Framework: Application to Cardiac
Magnetic Resonance Images [3.5354617056939874]
This work presents an automatic cascade pathology segmentation framework based on multi-modality CMR images.
It mainly consists of two neural networks: an anatomical structure segmentation network (ASSN) and a pathological region segmentation network (PRSN)
arXiv Detail & Related papers (2020-08-13T09:57:04Z) - Segmentation of the Myocardium on Late-Gadolinium Enhanced MRI based on
2.5 D Residual Squeeze and Excitation Deep Learning Model [55.09533240649176]
The aim of this work is to develop an accurate automatic segmentation method based on deep learning models for the myocardial borders on LGE-MRI.
A total number of 320 exams (with a mean number of 6 slices per exam) were used for training and 28 exams used for testing.
The performance analysis of the proposed ensemble model in the basal and middle slices was similar as compared to intra-observer study and slightly lower at apical slices.
arXiv Detail & Related papers (2020-05-27T20:44:38Z) - A Global Benchmark of Algorithms for Segmenting Late Gadolinium-Enhanced
Cardiac Magnetic Resonance Imaging [90.29017019187282]
" 2018 Left Atrium Challenge" using 154 3D LGE-MRIs, currently the world's largest cardiac LGE-MRI dataset.
Analyse of the submitted algorithms using technical and biological metrics was performed.
Results show the top method achieved a dice score of 93.2% and a mean surface to a surface distance of 0.7 mm.
arXiv Detail & Related papers (2020-04-26T08:49:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.