A Topology-Attention ConvLSTM Network and Its Application to EM Images
- URL: http://arxiv.org/abs/2202.03430v1
- Date: Mon, 7 Feb 2022 01:33:01 GMT
- Title: A Topology-Attention ConvLSTM Network and Its Application to EM Images
- Authors: Jiaqi Yang, Xiaoling Hu, Chao Chen, and Chialing Tsai
- Abstract summary: We propose a novel TopologyAttention ConvLSTM Network (TACNet) for 3D image segmentation.
Specifically, we propose a Spatial Topology-Attention (STA) module to process a 3D image as a stack of 2D image slices.
In order to effectively transfer topology-critical information across slices, we propose an Iterative-Topology Attention (ITA) module.
- Score: 11.081936935096873
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Structural accuracy of segmentation is important for finescale structures in
biomedical images. We propose a novel TopologyAttention ConvLSTM Network
(TACNet) for 3D image segmentation in order to achieve high structural accuracy
for 3D segmentation tasks. Specifically, we propose a Spatial
Topology-Attention (STA) module to process a 3D image as a stack of 2D image
slices and adopt ConvLSTM to leverage contextual structure information from
adjacent slices. In order to effectively transfer topology-critical information
across slices, we propose an Iterative-Topology Attention (ITA) module that
provides a more stable topology-critical map for segmentation. Quantitative and
qualitative results show that our proposed method outperforms various baselines
in terms of topology-aware evaluation metrics.
Related papers
- SeMLaPS: Real-time Semantic Mapping with Latent Prior Networks and
Quasi-Planar Segmentation [53.83313235792596]
We present a new methodology for real-time semantic mapping from RGB-D sequences.
It combines a 2D neural network and a 3D network based on a SLAM system with 3D occupancy mapping.
Our system achieves state-of-the-art semantic mapping quality within 2D-3D networks-based systems.
arXiv Detail & Related papers (2023-06-28T22:36:44Z) - HKNAS: Classification of Hyperspectral Imagery Based on Hyper Kernel
Neural Architecture Search [104.45426861115972]
We propose to directly generate structural parameters by utilizing the specifically designed hyper kernels.
We obtain three kinds of networks to separately conduct pixel-level or image-level classifications with 1-D or 3-D convolutions.
A series of experiments on six public datasets demonstrate that the proposed methods achieve state-of-the-art results.
arXiv Detail & Related papers (2023-04-23T17:27:40Z) - DCN-T: Dual Context Network with Transformer for Hyperspectral Image
Classification [109.09061514799413]
Hyperspectral image (HSI) classification is challenging due to spatial variability caused by complex imaging conditions.
We propose a tri-spectral image generation pipeline that transforms HSI into high-quality tri-spectral images.
Our proposed method outperforms state-of-the-art methods for HSI classification.
arXiv Detail & Related papers (2023-04-19T18:32:52Z) - Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud
Analysis [66.49788145564004]
We present an unsupervised deep neural architecture called Flattening-Net to represent irregular 3D point clouds of arbitrary geometry and topology.
Our methods perform favorably against the current state-of-the-art competitors.
arXiv Detail & Related papers (2022-12-17T15:05:25Z) - Two-Stream Graph Convolutional Network for Intra-oral Scanner Image
Segmentation [133.02190910009384]
We propose a two-stream graph convolutional network (i.e., TSGCN) to handle inter-view confusion between different raw attributes.
Our TSGCN significantly outperforms state-of-the-art methods in 3D tooth (surface) segmentation.
arXiv Detail & Related papers (2022-04-19T10:41:09Z) - Multi-organ Segmentation Network with Adversarial Performance Validator [10.775440368500416]
This paper introduces an adversarial performance validation network into a 2D-to-3D segmentation framework.
The proposed network converts the 2D-coarse result to 3D high-quality segmentation masks in a coarse-to-fine manner, allowing joint optimization to improve segmentation accuracy.
Experiments on the NIH pancreas segmentation dataset demonstrate the proposed network achieves state-of-the-art accuracy on small organ segmentation and outperforms the previous best.
arXiv Detail & Related papers (2022-04-16T18:00:29Z) - TC-Net: Triple Context Network for Automated Stroke Lesion Segmentation [0.5482532589225552]
We propose a new network, Triple Context Network (TC-Net), with the capture of spatial contextual information as the core.
Our network is evaluated on the open dataset ATLAS, achieving the highest score of 0.594, Hausdorff distance of 27.005 mm, and average symmetry surface distance of 7.137 mm.
arXiv Detail & Related papers (2022-02-28T11:12:16Z) - Topology-Preserving Segmentation Network: A Deep Learning Segmentation
Framework for Connected Component [7.95119530218428]
In medical imaging, the topology of the structure, such as the kidney or lung, is usually known.
A it topology-preserving segmentation network (TPSN) is trained to give an accurate segmentation result.
TPSN is a deformation-based model that yields a deformation map through a UNet.
A multi-scale TPSN is developed in this paper that incorporates multi-level information of images to produce more precise segmentation results.
arXiv Detail & Related papers (2022-02-27T09:56:33Z) - Image Segmentation with Homotopy Warping [10.093435601073484]
topological correctness is crucial for the segmentation of images with fine-scale structures.
By leveraging the theory of digital topology, we identify locations in an image that are critical for topology.
We propose a new homotopy warping loss to train deep image segmentation networks for better topological accuracy.
arXiv Detail & Related papers (2021-12-15T00:33:15Z) - SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform [49.51977253452456]
We present an efficient method for 3D shape segmentation based on the medial axis transform (MAT) of the input shape.
Specifically, with the rich geometrical and structural information encoded in the MAT, we are able to identify the various types of junctions between different parts of a 3D shape.
Our method outperforms the state-of-the-art methods in terms of segmentation quality and is also one order of magnitude faster.
arXiv Detail & Related papers (2020-10-22T07:15:23Z) - Brain segmentation based on multi-atlas guided 3D fully convolutional
network ensembles [1.52292571922932]
We propose and validated a multi-atlas guided 3D fully convolutional network (FCN) ensemble model (M-FCN) for segmenting brain regions of interest (ROIs) from structural magnetic resonance images (MRIs)
We trained a 3D FCN model for each ROI using patches of adaptive size and embedded outputs of the convolutional layers in the deconvolutional layers to further capture the local and global context patterns.
Our results suggested that the proposed method had a superior segmentation performance.
arXiv Detail & Related papers (2019-01-05T08:23:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.