Weakly Supervised Segmentation of Cracks on Solar Cells using Normalized Lp Norm

• URL: http://arxiv.org/abs/2001.11248v1
• Date: Thu, 30 Jan 2020 10:51:25 GMT
• Title: Weakly Supervised Segmentation of Cracks on Solar Cells using Normalized Lp Norm
• Authors: Martin Mayr, Mathis Hoffmann, Andreas Maier, Vincent Christlein
• Abstract summary: We propose a weakly supervised learning strategy to segment cracks on electroluminescence images of solar cells. We use a modified ResNet-50 to derive a segmentation from network activation maps. We show that the method has the potential to solve other weakly supervised segmentation problems as well.
• Score: 11.014960310006385
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Photovoltaic is one of the most important renewable energy sources for dealing with world-wide steadily increasing energy consumption. This raises the demand for fast and scalable automatic quality management during production and operation. However, the detection and segmentation of cracks on electroluminescence (EL) images of mono- or polycrystalline solar modules is a challenging task. In this work, we propose a weakly supervised learning strategy that only uses image-level annotations to obtain a method that is capable of segmenting cracks on EL images of solar cells. We use a modified ResNet-50 to derive a segmentation from network activation maps. We use defect classification as a surrogate task to train the network. To this end, we apply normalized Lp normalization to aggregate the activation maps into single scores for classification. In addition, we provide a study how different parameterizations of the normalized Lp layer affect the segmentation performance. This approach shows promising results for the given task. However, we think that the method has the potential to solve other weakly supervised segmentation problems as well.

Related papers

• A Comprehensive Case Study on the Performance of Machine Learning Methods on the Classification of Solar Panel Electroluminescence Images [0.5033467447713051]
  Solar cells in the field are vulnerable to various defects. Electroluminescence (EL) imaging provides effective and non-destructive diagnostics to detect those defects. We use multiple traditional machine learning and modern deep learning models to classify EL solar cell images into different functional/defective categories.
  arXiv  Detail & Related papers  (2024-08-12T15:29:32Z)
• ECLIPSE: Efficient Continual Learning in Panoptic Segmentation with Visual Prompt Tuning [54.68180752416519]
  Panoptic segmentation is a cutting-edge computer vision task. We introduce a novel and efficient method for continual panoptic segmentation based on Visual Prompt Tuning, dubbed ECLIPSE. Our approach involves freezing the base model parameters and fine-tuning only a small set of prompt embeddings, addressing both catastrophic forgetting and plasticity.
  arXiv  Detail & Related papers  (2024-03-29T11:31:12Z)
• CG-fusion CAM: Online segmentation of laser-induced damage on large-aperture optics [1.4658400971135652]
  We propose a weakly supervised semantic segmentation method with Continuous Gradient CAM and its nonlinear multi-scale fusion (CG-fusion CAM) The proposed method can achieve segmentation performance comparable to that of fully supervised algorithms.
  arXiv  Detail & Related papers  (2023-07-18T11:38:20Z)
• Skip-Attention: Improving Vision Transformers by Paying Less Attention [55.47058516775423]
  Vision computation transformers (ViTs) use expensive self-attention operations in every layer. We propose SkipAt, a method to reuse self-attention from preceding layers to approximate attention at one or more subsequent layers. We show the effectiveness of our method in image classification and self-supervised learning on ImageNet-1K, semantic segmentation on ADE20K, image denoising on SIDD, and video denoising on DAVIS.
  arXiv  Detail & Related papers  (2023-01-05T18:59:52Z)
• Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentation [141.16965264264195]
  Sparsely annotated semantic segmentation (SASS) aims to train a segmentation network with coarse-grained supervisions. We propose a novel tree energy loss for SASS by providing semantic guidance for unlabeled pixels.
  arXiv  Detail & Related papers  (2022-03-21T05:16:23Z)
• GETAM: Gradient-weighted Element-wise Transformer Attention Map for Weakly-supervised Semantic segmentation [29.184608129848105]
  Class Activation Map (CAM) is usually generated to provide pixel level pseudo labels. Transformer based methods are highly effective at exploring global context with long range dependency modeling. GETAM shows fine scale activation for all feature map elements, revealing different parts of the object across transformer layers.
  arXiv  Detail & Related papers  (2021-12-06T08:02:32Z)
• Weakly-supervised fire segmentation by visualizing intermediate CNN layers [82.75113406937194]
  Fire localization in images and videos is an important step for an autonomous system to combat fire incidents. We consider weakly supervised segmentation of fire in images, in which only image labels are used to train the network. We show that in the case of fire segmentation, which is a binary segmentation problem, the mean value of features in a mid-layer of classification CNN can perform better than conventional Class Activation Mapping (CAM) method.
  arXiv  Detail & Related papers  (2021-11-16T11:56:28Z)
• TSG: Target-Selective Gradient Backprop for Probing CNN Visual Saliency [72.9106103283475]
  We study the visual saliency, a.k.a. visual explanation, to interpret convolutional neural networks. Inspired by those observations, we propose a novel visual saliency framework, termed Target-Selective Gradient (TSG) backprop. The proposed TSG consists of two components, namely, TSG-Conv and TSG-FC, which rectify the gradients for convolutional layers and fully-connected layers, respectively.
  arXiv  Detail & Related papers  (2021-10-11T12:00:20Z)
• Module-Power Prediction from PL Measurements using Deep Learning [6.470549137572311]
  We apply a deep convolutional neural network to predict the module power from PL images with a mean absolute error (MAE) of 4.4% or 11.7WP. We depict that regression maps computed from the embeddings of the trained network can be used to compute the localized power loss.
  arXiv  Detail & Related papers  (2021-08-31T06:43:03Z)
• Segmentation of cell-level anomalies in electroluminescence images of photovoltaic modules [0.0]
  We propose an end-to-end deep learning pipeline that detects, locates and segments cell-level anomalies from entire photovoltaic modules. The proposed modular pipeline combines three deep learning techniques: 1. object detection (modified Faster-RNN), 2. image classification (EfficientNet) and 3. weakly supervised segmentation (autoencoder)
  arXiv  Detail & Related papers  (2021-06-21T10:17:40Z)
• Energy-Efficient and Federated Meta-Learning via Projected Stochastic Gradient Ascent [79.58680275615752]
  We propose an energy-efficient federated meta-learning framework. We assume each task is owned by a separate agent, so a limited number of tasks is used to train a meta-model.
  arXiv  Detail & Related papers  (2021-05-31T08:15:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.