Weakly-supervised fire segmentation by visualizing intermediate CNN layers

• URL: http://arxiv.org/abs/2111.08401v1
• Date: Tue, 16 Nov 2021 11:56:28 GMT
• Title: Weakly-supervised fire segmentation by visualizing intermediate CNN layers
• Authors: Milad Niknejad, Alexandre Bernardino
• Abstract summary: Fire localization in images and videos is an important step for an autonomous system to combat fire incidents. We consider weakly supervised segmentation of fire in images, in which only image labels are used to train the network. We show that in the case of fire segmentation, which is a binary segmentation problem, the mean value of features in a mid-layer of classification CNN can perform better than conventional Class Activation Mapping (CAM) method.
• Score: 82.75113406937194
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fire localization in images and videos is an important step for an autonomous system to combat fire incidents. State-of-art image segmentation methods based on deep neural networks require a large number of pixel-annotated samples to train Convolutional Neural Networks (CNNs) in a fully-supervised manner. In this paper, we consider weakly supervised segmentation of fire in images, in which only image labels are used to train the network. We show that in the case of fire segmentation, which is a binary segmentation problem, the mean value of features in a mid-layer of classification CNN can perform better than conventional Class Activation Mapping (CAM) method. We also propose to further improve the segmentation accuracy by adding a rotation equivariant regularization loss on the features of the last convolutional layer. Our results show noticeable improvements over baseline method for weakly-supervised fire segmentation.

Related papers

• A Sneak Attack on Segmentation of Medical Images Using Deep Neural Network Classifiers [0.0]
  We use trained Convolutional Neural Network (CNN) classifiers to approach the segmentation problem. Heatmaps can be visualized and formed using Gradient-weighted Class Activation Mapping (Grad-CAM) Results from our experiments show that heatmaps can locate and segment partial tumor areas.
  arXiv  Detail & Related papers  (2022-01-08T05:57:26Z)
• Attention on Classification for Fire Segmentation [82.75113406937194]
  We propose a Convolutional Neural Network (CNN) for joint classification and segmentation of fire in images. We use a spatial self-attention mechanism to capture long-range dependency between pixels, and a new channel attention module which uses the classification probability as an attention weight.
  arXiv  Detail & Related papers  (2021-11-04T19:52:49Z)
• New SAR target recognition based on YOLO and very deep multi-canonical correlation analysis [0.1503974529275767]
  This paper proposes a robust feature extraction method for SAR image target classification by adaptively fusing effective features from different CNN layers. Experiments on the MSTAR dataset demonstrate that the proposed method outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-10-28T18:10:26Z)
• Local Critic Training for Model-Parallel Learning of Deep Neural Networks [94.69202357137452]
  We propose a novel model-parallel learning method, called local critic training. We show that the proposed approach successfully decouples the update process of the layer groups for both convolutional neural networks (CNNs) and recurrent neural networks (RNNs) We also show that trained networks by the proposed method can be used for structural optimization.
  arXiv  Detail & Related papers  (2021-02-03T09:30:45Z)
• Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation [49.90178055521207]
  This work addresses weakly supervised semantic segmentation (WSSS), with the goal of bridging the gap between image-level annotations and pixel-level segmentation. We formulate WSSS as a novel group-wise learning task that explicitly models semantic dependencies in a group of images to estimate more reliable pseudo ground-truths. In particular, we devise a graph neural network (GNN) for group-wise semantic mining, wherein input images are represented as graph nodes.
  arXiv  Detail & Related papers  (2020-12-09T12:40:13Z)
• Region Growing with Convolutional Neural Networks for Biomedical Image Segmentation [1.5469452301122177]
  We present a methodology that uses convolutional neural networks (CNNs) for segmentation by iteratively growing predicted mask regions in each coordinate direction. We use a threshold on the CNN probability scores to determine whether pixels are added to the region and the iteration continues until no new pixels are added to the region. Our method is able to achieve high segmentation accuracy and preserve biologically realistic morphological features while leveraging small amounts of training data and maintaining computational efficiency.
  arXiv  Detail & Related papers  (2020-09-23T17:53:00Z)
• Learning CNN filters from user-drawn image markers for coconut-tree image classification [78.42152902652215]
  We present a method that needs a minimal set of user-selected images to train the CNN's feature extractor. The method learns the filters of each convolutional layer from user-drawn markers in image regions that discriminate classes. It does not rely on optimization based on backpropagation, and we demonstrate its advantages on the binary classification of coconut-tree aerial images.
  arXiv  Detail & Related papers  (2020-08-08T15:50:23Z)
• CRNet: Cross-Reference Networks for Few-Shot Segmentation [59.85183776573642]
  Few-shot segmentation aims to learn a segmentation model that can be generalized to novel classes with only a few training images. With a cross-reference mechanism, our network can better find the co-occurrent objects in the two images. Experiments on the PASCAL VOC 2012 dataset show that our network achieves state-of-the-art performance.
  arXiv  Detail & Related papers  (2020-03-24T04:55:43Z)
• Medical Image Segmentation via Unsupervised Convolutional Neural Network [1.6396833577035679]
  We present a novel learning-based segmentation model that could be trained semi- or un- supervised. We parameterize the Active contour without edges (ACWE) framework via a convolutional neural network (ConvNet) We show that the method provides fast and high-quality bone segmentation in the context of single-photon emission computed tomography (SPECT) image.
  arXiv  Detail & Related papers  (2020-01-28T03:56:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.