Adaptive feature recombination and recalibration for semantic segmentation with Fully Convolutional Networks

• URL: http://arxiv.org/abs/2006.11193v1
• Date: Fri, 19 Jun 2020 15:45:03 GMT
• Title: Adaptive feature recombination and recalibration for semantic segmentation with Fully Convolutional Networks
• Authors: Sergio Pereira, Adriano Pinto, Joana Amorim, Alexandrine Ribeiro, Victor Alves, Carlos A. Silva
• Abstract summary: We propose recombination of features and a spatially adaptive recalibration block that is adapted for semantic segmentation with Fully Convolutional Networks. Results indicate that Recombination and Recalibration improve the results of a competitive baseline, and generalize across three different problems.
• Score: 57.64866581615309
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fully Convolutional Networks have been achieving remarkable results in image semantic segmentation, while being efficient. Such efficiency results from the capability of segmenting several voxels in a single forward pass. So, there is a direct spatial correspondence between a unit in a feature map and the voxel in the same location. In a convolutional layer, the kernel spans over all channels and extracts information from them. We observe that linear recombination of feature maps by increasing the number of channels followed by compression may enhance their discriminative power. Moreover, not all feature maps have the same relevance for the classes being predicted. In order to learn the inter-channel relationships and recalibrate the channels to suppress the less relevant ones, Squeeze and Excitation blocks were proposed in the context of image classification with Convolutional Neural Networks. However, this is not well adapted for segmentation with Fully Convolutional Networks since they segment several objects simultaneously, hence a feature map may contain relevant information only in some locations. In this paper, we propose recombination of features and a spatially adaptive recalibration block that is adapted for semantic segmentation with Fully Convolutional Networks - the SegSE block. Feature maps are recalibrated by considering the cross-channel information together with spatial relevance. Experimental results indicate that Recombination and Recalibration improve the results of a competitive baseline, and generalize across three different problems: brain tumor segmentation, stroke penumbra estimation, and ischemic stroke lesion outcome prediction. The obtained results are competitive or outperform the state of the art in the three applications.

Related papers

• Multilayer Multiset Neuronal Networks -- MMNNs [55.2480439325792]
  The present work describes multilayer multiset neuronal networks incorporating two or more layers of coincidence similarity neurons. The work also explores the utilization of counter-prototype points, which are assigned to the image regions to be avoided.
  arXiv  Detail & Related papers  (2023-08-28T12:55:13Z)
• Augmenting Convolutional networks with attention-based aggregation [55.97184767391253]
  We show how to augment any convolutional network with an attention-based global map to achieve non-local reasoning. We plug this learned aggregation layer with a simplistic patch-based convolutional network parametrized by 2 parameters (width and depth) It yields surprisingly competitive trade-offs between accuracy and complexity, in particular in terms of memory consumption.
  arXiv  Detail & Related papers  (2021-12-27T14:05:41Z)
• Fully Attentional Network for Semantic Segmentation [17.24768249911501]
  We propose Fully Attentional Network (FLANet) to encode both spatial and channel attentions in a single similarity map. Our new method has achieved state-of-the-art performance on three challenging semantic segmentation datasets.
  arXiv  Detail & Related papers  (2021-12-08T04:34:55Z)
• Group Fisher Pruning for Practical Network Compression [58.25776612812883]
  We present a general channel pruning approach that can be applied to various complicated structures. We derive a unified metric based on Fisher information to evaluate the importance of a single channel and coupled channels. Our method can be used to prune any structures including those with coupled channels.
  arXiv  Detail & Related papers  (2021-08-02T08:21:44Z)
• A persistent homology-based topological loss for CNN-based multi-class segmentation of CMR [5.898114915426535]
  Multi-class segmentation of cardiac magnetic resonance (CMR) images seeks a separation of data into anatomical components with known structure and configuration. Most popular CNN-based methods are optimised using pixel wise loss functions, ignorant of the spatially extended features that characterise anatomy. We extend these approaches to the task of multi-class segmentation by building an enriched topological description of all class labels and class label pairs.
  arXiv  Detail & Related papers  (2021-07-27T09:21:38Z)
• 3D Medical Multi-modal Segmentation Network Guided by Multi-source Correlation Constraint [2.867517731896504]
  We propose a multi-modality segmentation network with a correlation constraint. Our experiment results tested on BraTS-2018 dataset for brain tumor segmentation demonstrate the effectiveness of our proposed method.
  arXiv  Detail & Related papers  (2021-02-05T11:23:12Z)
• Towards Efficient Scene Understanding via Squeeze Reasoning [71.1139549949694]
  We propose a novel framework called Squeeze Reasoning. Instead of propagating information on the spatial map, we first learn to squeeze the input feature into a channel-wise global vector. We show that our approach can be modularized as an end-to-end trained block and can be easily plugged into existing networks.
  arXiv  Detail & Related papers  (2020-11-06T12:17:01Z)
• Channel Compression: Rethinking Information Redundancy among Channels in CNN Architecture [3.3018563701013988]
  Research on efficient convolutional neural networks (CNNs) aims at removing feature redundancy by decomposing or optimizing the convolutional calculation. In this work, feature redundancy is assumed to exist among channels in CNN architectures, which provides some leeway to boost calculation efficiency. A novel convolutional construction named compact convolution is proposed to embrace the progress in spatial convolution, channel grouping and pooling operation.
  arXiv  Detail & Related papers  (2020-07-02T10:58:54Z)
• clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentation [57.20783326661043]
  We introduce a novel similarity measure termed centerlineDice (short clDice) We theoretically prove that clDice guarantees topology preservation up to homotopy equivalence for binary 2D and 3D segmentation. We benchmark the soft-clDice loss on five public datasets, including vessels, roads and neurons (2D and 3D)
  arXiv  Detail & Related papers  (2020-03-16T16:27:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.