ViGU: Vision GNN U-Net for Fast MRI
- URL: http://arxiv.org/abs/2302.10273v1
- Date: Mon, 23 Jan 2023 12:51:57 GMT
- Title: ViGU: Vision GNN U-Net for Fast MRI
- Authors: Jiahao Huang, Angelica Aviles-Rivero, Carola-Bibiane Schonlieb, Guang
Yang
- Abstract summary: We introduce a novel Vision GNN type network for fast MRI called Vision GNN U-Net (ViGU)
A U-shape network is developed using several graph blocks in symmetrical encoder and decoder paths.
We demonstrate, through numerical and visual experiments, that the proposed ViGU and GAN variant outperform existing CNN and GAN-based methods.
- Score: 1.523157765626545
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep learning models have been widely applied for fast MRI. The majority of
existing deep learning models, e.g., convolutional neural networks, work on
data with Euclidean or regular grids structures. However, high-dimensional
features extracted from MR data could be encapsulated in non-Euclidean
manifolds. This disparity between the go-to assumption of existing models and
data requirements limits the flexibility to capture irregular anatomical
features in MR data. In this work, we introduce a novel Vision GNN type network
for fast MRI called Vision GNN U-Net (ViGU). More precisely, the pixel array is
first embedded into patches and then converted into a graph. Secondly, a
U-shape network is developed using several graph blocks in symmetrical encoder
and decoder paths. Moreover, we show that the proposed ViGU can also benefit
from Generative Adversarial Networks yielding to its variant ViGU-GAN. We
demonstrate, through numerical and visual experiments, that the proposed ViGU
and GAN variant outperform existing CNN and GAN-based methods. Moreover, we
show that the proposed network readily competes with approaches based on
Transformers while requiring a fraction of the computational cost. More
importantly, the graph structure of the network reveals how the network
extracts features from MR images, providing intuitive explainability.
Related papers
- CNN2GNN: How to Bridge CNN with GNN [59.42117676779735]
We propose a novel CNN2GNN framework to unify CNN and GNN together via distillation.
The performance of distilled boosted'' two-layer GNN on Mini-ImageNet is much higher than CNN containing dozens of layers such as ResNet152.
arXiv Detail & Related papers (2024-04-23T08:19:08Z) - Compact & Capable: Harnessing Graph Neural Networks and Edge Convolution
for Medical Image Classification [0.0]
We introduce a novel model that combines GNNs and edge convolution, leveraging the interconnectedness of RGB channel feature values to strongly represent connections between crucial graph nodes.
Our proposed model performs on par with state-of-the-art Deep Neural Networks (DNNs) but does so with 1000 times fewer parameters, resulting in reduced training time and data requirements.
arXiv Detail & Related papers (2023-07-24T13:39:21Z) - ViG-UNet: Vision Graph Neural Networks for Medical Image Segmentation [7.802846775068384]
We propose a graph neural network-based U-shaped architecture with the encoder, the decoder, the bottleneck, and skip connections.
The experimental results on ISIC 2016, ISIC 2017 and Kvasir-SEG datasets demonstrate that our proposed architecture outperforms most existing classic and state-of-the-art U-shaped networks.
arXiv Detail & Related papers (2023-06-08T03:17:00Z) - Binary Graph Neural Networks [69.51765073772226]
Graph Neural Networks (GNNs) have emerged as a powerful and flexible framework for representation learning on irregular data.
In this paper, we present and evaluate different strategies for the binarization of graph neural networks.
We show that through careful design of the models, and control of the training process, binary graph neural networks can be trained at only a moderate cost in accuracy on challenging benchmarks.
arXiv Detail & Related papers (2020-12-31T18:48:58Z) - Spatio-Temporal Inception Graph Convolutional Networks for
Skeleton-Based Action Recognition [126.51241919472356]
We design a simple and highly modularized graph convolutional network architecture for skeleton-based action recognition.
Our network is constructed by repeating a building block that aggregates multi-granularity information from both the spatial and temporal paths.
arXiv Detail & Related papers (2020-11-26T14:43:04Z) - Data-Driven Learning of Geometric Scattering Networks [74.3283600072357]
We propose a new graph neural network (GNN) module based on relaxations of recently proposed geometric scattering transforms.
Our learnable geometric scattering (LEGS) module enables adaptive tuning of the wavelets to encourage band-pass features to emerge in learned representations.
arXiv Detail & Related papers (2020-10-06T01:20:27Z) - A Unified View on Graph Neural Networks as Graph Signal Denoising [49.980783124401555]
Graph Neural Networks (GNNs) have risen to prominence in learning representations for graph structured data.
In this work, we establish mathematically that the aggregation processes in a group of representative GNN models can be regarded as solving a graph denoising problem.
We instantiate a novel GNN model, ADA-UGNN, derived from UGNN, to handle graphs with adaptive smoothness across nodes.
arXiv Detail & Related papers (2020-10-05T04:57:18Z) - Binarized Graph Neural Network [65.20589262811677]
We develop a binarized graph neural network to learn the binary representations of the nodes with binary network parameters.
Our proposed method can be seamlessly integrated into the existing GNN-based embedding approaches.
Experiments indicate that the proposed binarized graph neural network, namely BGN, is orders of magnitude more efficient in terms of both time and space.
arXiv Detail & Related papers (2020-04-19T09:43:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.