Attention on Classification for Fire Segmentation
- URL: http://arxiv.org/abs/2111.03129v1
- Date: Thu, 4 Nov 2021 19:52:49 GMT
- Title: Attention on Classification for Fire Segmentation
- Authors: Milad Niknejad, Alexandre Bernardino
- Abstract summary: We propose a Convolutional Neural Network (CNN) for joint classification and segmentation of fire in images.
We use a spatial self-attention mechanism to capture long-range dependency between pixels, and a new channel attention module which uses the classification probability as an attention weight.
- Score: 82.75113406937194
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Detection and localization of fire in images and videos are important in
tackling fire incidents. Although semantic segmentation methods can be used to
indicate the location of pixels with fire in the images, their predictions are
localized, and they often fail to consider global information of the existence
of fire in the image which is implicit in the image labels. We propose a
Convolutional Neural Network (CNN) for joint classification and segmentation of
fire in images which improves the performance of the fire segmentation. We use
a spatial self-attention mechanism to capture long-range dependency between
pixels, and a new channel attention module which uses the classification
probability as an attention weight. The network is jointly trained for both
segmentation and classification, leading to improvement in the performance of
the single-task image segmentation methods, and the previous methods proposed
for fire segmentation.
Related papers
- Learning Semantic Segmentation with Query Points Supervision on Aerial Images [57.09251327650334]
We present a weakly supervised learning algorithm to train semantic segmentation algorithms.
Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation.
arXiv Detail & Related papers (2023-09-11T14:32:04Z) - Location-Aware Self-Supervised Transformers [74.76585889813207]
We propose to pretrain networks for semantic segmentation by predicting the relative location of image parts.
We control the difficulty of the task by masking a subset of the reference patch features visible to those of the query.
Our experiments show that this location-aware pretraining leads to representations that transfer competitively to several challenging semantic segmentation benchmarks.
arXiv Detail & Related papers (2022-12-05T16:24:29Z) - LEAD: Self-Supervised Landmark Estimation by Aligning Distributions of
Feature Similarity [49.84167231111667]
Existing works in self-supervised landmark detection are based on learning dense (pixel-level) feature representations from an image.
We introduce an approach to enhance the learning of dense equivariant representations in a self-supervised fashion.
We show that having such a prior in the feature extractor helps in landmark detection, even under drastically limited number of annotations.
arXiv Detail & Related papers (2022-04-06T17:48:18Z) - A Sneak Attack on Segmentation of Medical Images Using Deep Neural
Network Classifiers [0.0]
We use trained Convolutional Neural Network (CNN) classifiers to approach the segmentation problem.
Heatmaps can be visualized and formed using Gradient-weighted Class Activation Mapping (Grad-CAM)
Results from our experiments show that heatmaps can locate and segment partial tumor areas.
arXiv Detail & Related papers (2022-01-08T05:57:26Z) - Weakly-supervised fire segmentation by visualizing intermediate CNN
layers [82.75113406937194]
Fire localization in images and videos is an important step for an autonomous system to combat fire incidents.
We consider weakly supervised segmentation of fire in images, in which only image labels are used to train the network.
We show that in the case of fire segmentation, which is a binary segmentation problem, the mean value of features in a mid-layer of classification CNN can perform better than conventional Class Activation Mapping (CAM) method.
arXiv Detail & Related papers (2021-11-16T11:56:28Z) - Maximize the Exploration of Congeneric Semantics for Weakly Supervised
Semantic Segmentation [27.155133686127474]
We construct a graph neural network (P-GNN) based on the self-detected patches from different images that contain the same class labels.
We conduct experiments on the popular PASCAL VOC 2012 benchmarks, and our model yields state-of-the-art performance.
arXiv Detail & Related papers (2021-10-08T08:59:16Z) - Semantic Distribution-aware Contrastive Adaptation for Semantic
Segmentation [50.621269117524925]
Domain adaptive semantic segmentation refers to making predictions on a certain target domain with only annotations of a specific source domain.
We present a semantic distribution-aware contrastive adaptation algorithm that enables pixel-wise representation alignment.
We evaluate SDCA on multiple benchmarks, achieving considerable improvements over existing algorithms.
arXiv Detail & Related papers (2021-05-11T13:21:25Z) - Fire Threat Detection From Videos with Q-Rough Sets [0.0]
Fire in control serves a number of purposes to human civilization, but it could simultaneously be a threat once its spread becomes uncontrolled.
Here we focus on developing an unsupervised method with which the threat of fire can be quantified.
All theories and indices defined here have been experimentally validated with different types of fire videos.
arXiv Detail & Related papers (2021-01-21T06:29:36Z) - Learning unbiased zero-shot semantic segmentation networks via
transductive transfer [14.55508599873219]
We propose an easy-to-implement transductive approach to alleviate the prediction bias in zero-shot semantic segmentation.
Our method assumes both the source images with full pixel-level labels and unlabeled target images are available during training.
arXiv Detail & Related papers (2020-07-01T14:25:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.