Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning

• URL: http://arxiv.org/abs/2112.02922v1
• Date: Mon, 6 Dec 2021 10:42:28 GMT
• Title: Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning
• Authors: Lukas Bommes, Mathis Hoffmann, Claudia Buerhop-Lutz, Tobias Pickel, Jens Hauch, Christoph Brabec, Andreas Maier, Ian Marius Peters
• Abstract summary: We train a ResNet-34 convolutional neural network with a supervised contrastive loss to detect anomalies in infrared images. Our method converges quickly and reliably detects unknown types of anomalies making it well suited for practice. Our work serves the community with a more realistic view on PV module fault detection using unsupervised domain adaptation.
• Score: 4.409996772486956
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Increasing deployment of photovoltaic (PV) plants requires methods for automatic detection of faulty PV modules in modalities, such as infrared (IR) images. Recently, deep learning has become popular for this. However, related works typically sample train and test data from the same distribution ignoring the presence of domain shift between data of different PV plants. Instead, we frame fault detection as more realistic unsupervised domain adaptation problem where we train on labelled data of one source PV plant and make predictions on another target plant. We train a ResNet-34 convolutional neural network with a supervised contrastive loss, on top of which we employ a k-nearest neighbor classifier to detect anomalies. Our method achieves a satisfactory area under the receiver operating characteristic (AUROC) of 73.3 % to 96.6 % on nine combinations of four source and target datasets with 2.92 million IR images of which 8.5 % are anomalous. It even outperforms a binary cross-entropy classifier in some cases. With a fixed decision threshold this results in 79.4 % and 77.1 % correctly classified normal and anomalous images, respectively. Most misclassified anomalies are of low severity, such as hot diodes and small hot spots. Our method is insensitive to hyperparameter settings, converges quickly and reliably detects unknown types of anomalies making it well suited for practice. Possible uses are in automatic PV plant inspection systems or to streamline manual labelling of IR datasets by filtering out normal images. Furthermore, our work serves the community with a more realistic view on PV module fault detection using unsupervised domain adaptation to develop more performant methods with favorable generalization capabilities.

Related papers

• Online-Adaptive Anomaly Detection for Defect Identification in Aircraft Assembly [4.387337528923525]
  Anomaly detection deals with detecting deviations from established patterns within data. We propose a novel framework for online-adaptive anomaly detection using transfer learning. Experimental results showcase a detection accuracy exceeding 0.975, outperforming the state-of-the-art ET-NET approach.
  arXiv  Detail & Related papers  (2024-06-18T15:11:44Z)
• Self-supervised Feature Adaptation for 3D Industrial Anomaly Detection [59.41026558455904]
  We focus on multi-modal anomaly detection. Specifically, we investigate early multi-modal approaches that attempted to utilize models pre-trained on large-scale visual datasets. We propose a Local-to-global Self-supervised Feature Adaptation (LSFA) method to finetune the adaptors and learn task-oriented representation toward anomaly detection.
  arXiv  Detail & Related papers  (2024-01-06T07:30:41Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Learning a Cross-modality Anomaly Detector for Remote Sensing Imagery [21.444315419064882]
  A remote sensing anomaly detector can find objects deviating from the background as potential targets for Earth monitoring. Current anomaly detectors aim to learn the certain background distribution, the trained model cannot be transferred to unseen images. This study exploits the learning target conversion from the varying background distribution to the consistent deviation metric.
  arXiv  Detail & Related papers  (2023-10-11T14:07:05Z)
• Learning Heavily-Degraded Prior for Underwater Object Detection [59.5084433933765]
  This paper seeks transferable prior knowledge from detector-friendly images. It is based on statistical observations that, the heavily degraded regions of detector-friendly (DFUI) and underwater images have evident feature distribution gaps. Our method with higher speeds and less parameters still performs better than transformer-based detectors.
  arXiv  Detail & Related papers  (2023-08-24T12:32:46Z)
• Detecting Anomalies using Generative Adversarial Networks on Images [0.0]
  This paper proposes a novel Generative Adversarial Network (GAN) based model for anomaly detection. It uses normal (non-anomalous) images to learn about the normality based on which it detects if an input image contains an anomalous/threat object. Experiments are performed on three datasets, viz. CIFAR-10, MVTec AD (for industrial applications) and SIXray (for X-ray baggage security)
  arXiv  Detail & Related papers  (2022-11-24T21:52:25Z)
• Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection [122.4894940892536]
  We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level. In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
  arXiv  Detail & Related papers  (2022-09-25T04:56:10Z)
• Georeferencing of Photovoltaic Modules from Aerial Infrared Videos using Structure-from-Motion [0.0]
  We use structure-from-motion to automatically obtain geocoordinates of all PV modules in a plant based on visual cues and the measured GPS trajectory of the drone. We successfully map 99.3 % of the 35084 modules in four large-scale and one rooftop plant and extract over 2.2 million module images.
  arXiv  Detail & Related papers  (2022-04-06T11:17:08Z)
• A Multi-Stage model based on YOLOv3 for defect detection in PV panels based on IR and Visible Imaging by Unmanned Aerial Vehicle [65.99880594435643]
  We propose a novel model to detect panel defects on aerial images captured by unmanned aerial vehicle. The model combines detections of panels and defects to refine its accuracy. The proposed model has been validated on two big PV plants in the south of Italy.
  arXiv  Detail & Related papers  (2021-11-23T08:04:32Z)
• A Hierarchical Transformation-Discriminating Generative Model for Few Shot Anomaly Detection [93.38607559281601]
  We devise a hierarchical generative model that captures the multi-scale patch distribution of each training image. The anomaly score is obtained by aggregating the patch-based votes of the correct transformation across scales and image regions.
  arXiv  Detail & Related papers  (2021-04-29T17:49:48Z)
• Unsupervised Abnormality Detection Using Heterogeneous Autonomous Systems [0.3867363075280543]
  Anomaly detection in a surveillance scenario is an emerging and challenging field of research. In this paper, a heterogeneous system is proposed which estimates the degree of abnormality of an unmanned surveillance drone. The proposed method performs satisfactorily on the IEEE SP Cup-2020 dataset with an accuracy of 97.3%.
  arXiv  Detail & Related papers  (2020-06-05T23:09:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.