A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and
Decision Making in Medical Imaging
- URL: http://arxiv.org/abs/2303.00175v2
- Date: Thu, 2 Mar 2023 01:40:50 GMT
- Title: A Deep Neural Architecture for Harmonizing 3-D Input Data Analysis and
Decision Making in Medical Imaging
- Authors: Dimitrios Kollias and Anastasios Arsenos and Stefanos Kollias
- Abstract summary: This paper presents a new deep neural architecture, named RACNet, which includes routing and feature alignment steps.
It effectively handles different input lengths and single annotations of the 3-D image inputs, whilst providing highly accurate decisions.
In addition, through latent variable extraction from the trained RACNet, a set of anchors are generated providing further insight on the network's decision making.
- Score: 3.6170587429082195
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Harmonizing the analysis of data, especially of 3-D image volumes, consisting
of different number of slices and annotated per volume, is a significant
problem in training and using deep neural networks in various applications,
including medical imaging. Moreover, unifying the decision making of the
networks over different input datasets is crucial for the generation of rich
data-driven knowledge and for trusted usage in the applications. This paper
presents a new deep neural architecture, named RACNet, which includes routing
and feature alignment steps and effectively handles different input lengths and
single annotations of the 3-D image inputs, whilst providing highly accurate
decisions. In addition, through latent variable extraction from the trained
RACNet, a set of anchors are generated providing further insight on the
network's decision making. These can be used to enrich and unify data-driven
knowledge extracted from different datasets. An extensive experimental study
illustrates the above developments, focusing on COVID-19 diagnosis through
analysis of 3-D chest CT scans from databases generated in different countries
and medical centers.
Related papers
- DmADs-Net: Dense multiscale attention and depth-supervised network for medical image segmentation [10.85494240952418]
We have created the Multiscale Attention and Depth-Supervised Network (DmADs-Net)
We use ResNet for feature extraction at different depths and create a Multi-scale Convolutional Feature Attention Block.
The Local Feature Attention Block is created to enable enhanced local feature attention for high-level semantic information.
In the feature fusion phase, a Feature Refinement and Fusion Block is created to enhance the fusion of different semantic information.
arXiv Detail & Related papers (2024-05-01T12:15:58Z) - QUBIQ: Uncertainty Quantification for Biomedical Image Segmentation Challenge [93.61262892578067]
Uncertainty in medical image segmentation tasks, especially inter-rater variability, presents a significant challenge.
This variability directly impacts the development and evaluation of automated segmentation algorithms.
We report the set-up and summarize the benchmark results of the Quantification of Uncertainties in Biomedical Image Quantification Challenge (QUBIQ)
arXiv Detail & Related papers (2024-03-19T17:57:24Z) - Predicting Infant Brain Connectivity with Federated Multi-Trajectory
GNNs using Scarce Data [54.55126643084341]
Existing deep learning solutions suffer from three major limitations.
We introduce FedGmTE-Net++, a federated graph-based multi-trajectory evolution network.
Using the power of federation, we aggregate local learnings among diverse hospitals with limited datasets.
arXiv Detail & Related papers (2024-01-01T10:20:01Z) - How You Split Matters: Data Leakage and Subject Characteristics Studies
in Longitudinal Brain MRI Analysis [0.0]
Deep learning models have revolutionized the field of medical image analysis, offering significant promise for improved diagnostics and patient care.
However, their performance can be misleadingly optimistic due to a hidden pitfall called 'data leakage'
In this study, we investigate data leakage in 3D medical imaging, specifically using 3D Convolutional Neural Networks (CNNs) for brain MRI analysis.
arXiv Detail & Related papers (2023-09-01T09:15:06Z) - Source-Free Collaborative Domain Adaptation via Multi-Perspective
Feature Enrichment for Functional MRI Analysis [55.03872260158717]
Resting-state MRI functional (rs-fMRI) is increasingly employed in multi-site research to aid neurological disorder analysis.
Many methods have been proposed to reduce fMRI heterogeneity between source and target domains.
But acquiring source data is challenging due to concerns and/or data storage burdens in multi-site studies.
We design a source-free collaborative domain adaptation framework for fMRI analysis, where only a pretrained source model and unlabeled target data are accessible.
arXiv Detail & Related papers (2023-08-24T01:30:18Z) - Fighting the scanner effect in brain MRI segmentation with a progressive
level-of-detail network trained on multi-site data [1.6379393441314491]
LOD-Brain is a 3D convolutional neural network with progressive levels-of-detail able to segment brain data from any site.
It produces state-of-the-art results, with no significant difference in performance between internal and external sites.
Its portability opens the way for large scale application across different healthcare institutions, patient populations, and imaging technology manufacturers.
arXiv Detail & Related papers (2022-11-04T12:15:18Z) - Slice-level Detection of Intracranial Hemorrhage on CT Using Deep
Descriptors of Adjacent Slices [0.31317409221921133]
We propose a new strategy to train emphslice-level classifiers on CT scans based on the descriptors of the adjacent slices along the axis.
We obtain a single model in the top 4% best-performing solutions of the RSNA Intracranial Hemorrhage dataset challenge.
The proposed method is general and can be applied to other 3D medical diagnosis tasks such as MRI imaging.
arXiv Detail & Related papers (2022-08-05T23:20:37Z) - Mutual Attention-based Hybrid Dimensional Network for Multimodal Imaging
Computer-aided Diagnosis [4.657804635843888]
We propose a novel mutual attention-based hybrid dimensional network for MultiModal 3D medical image classification (MMNet)
The hybrid dimensional network integrates 2D CNN with 3D convolution modules to generate deeper and more informative feature maps.
We further design a mutual attention framework in the network to build the region-wise consistency in similar stereoscopic regions of different image modalities.
arXiv Detail & Related papers (2022-01-24T02:31:25Z) - TSGCNet: Discriminative Geometric Feature Learning with Two-Stream
GraphConvolutional Network for 3D Dental Model Segmentation [141.2690520327948]
We propose a two-stream graph convolutional network (TSGCNet) to learn multi-view information from different geometric attributes.
We evaluate our proposed TSGCNet on a real-patient dataset of dental models acquired by 3D intraoral scanners.
arXiv Detail & Related papers (2020-12-26T08:02:56Z) - Fader Networks for domain adaptation on fMRI: ABIDE-II study [68.5481471934606]
We use 3D convolutional autoencoders to build the domain irrelevant latent space image representation and demonstrate this method to outperform existing approaches on ABIDE data.
arXiv Detail & Related papers (2020-10-14T16:50:50Z) - MS-Net: Multi-Site Network for Improving Prostate Segmentation with
Heterogeneous MRI Data [75.73881040581767]
We propose a novel multi-site network (MS-Net) for improving prostate segmentation by learning robust representations.
Our MS-Net improves the performance across all datasets consistently, and outperforms state-of-the-art methods for multi-site learning.
arXiv Detail & Related papers (2020-02-09T14:11:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.