Computer Vision Tool for Detection, Mapping and Fault Classification of PV Modules in Aerial IR Videos

• URL: http://arxiv.org/abs/2106.07314v1
• Date: Mon, 14 Jun 2021 11:38:13 GMT
• Title: Computer Vision Tool for Detection, Mapping and Fault Classification of PV Modules in Aerial IR Videos
• Authors: Lukas Bommes, Tobias Pickel, Claudia Buerhop-Lutz, Jens Hauch, Christoph Brabec, Ian Marius Peters
• Abstract summary: We develop a computer vision tool for the semi-automatic extraction of PV modules from thermographic UAV videos. We use it to curate a dataset containing 4.3 million IR images of 107842 PV modules from thermographic videos of seven different PV plants.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Increasing deployment of photovoltaics (PV) plants demands for cheap and fast inspection. A viable tool for this task is thermographic imaging by unmanned aerial vehicles (UAV). In this work, we develop a computer vision tool for the semi-automatic extraction of PV modules from thermographic UAV videos. We use it to curate a dataset containing 4.3 million IR images of 107842 PV modules from thermographic videos of seven different PV plants. To demonstrate its use for automated PV plant inspection, we train a ResNet-50 to classify ten common module anomalies with more than 90 % test accuracy. Experiments show that our tool generalizes well to different PV plants. It successfully extracts PV modules from 512 out of 561 plant rows. Failures are mostly due to an inappropriate UAV trajectory and erroneous module segmentation. Including all manual steps our tool enables inspection of 3.5 MW p to 9 MW p of PV installations per day, potentially scaling to multi-gigawatt plants due to its parallel nature. While we present an effective method for automated PV plant inspection, we are also confident that our approach helps to meet the growing demand for large thermographic datasets for machine learning tasks, such as power prediction or unsupervised defect identification.

Related papers

• Cross-variable Linear Integrated ENhanced Transformer for Photovoltaic power forecasting [2.1799192736303783]
  PV-Client employs an ENhanced Transformer module to capture complex interactions of various features in PV systems. PV-Client streamlines the embedding and position encoding layers by replacing the Decoder module with a projection layer. Experimental results on three real-world PV power datasets affirm PV-Client's state-of-the-art (SOTA) performance in PV power forecasting.
  arXiv  Detail & Related papers  (2024-06-06T07:30:27Z)
• Tri-Perspective View for Vision-Based 3D Semantic Occupancy Prediction [84.94140661523956]
  We propose a tri-perspective view (TPV) representation which accompanies BEV with two additional perpendicular planes. We model each point in the 3D space by summing its projected features on the three planes. Experiments show that our model trained with sparse supervision effectively predicts the semantic occupancy for all voxels.
  arXiv  Detail & Related papers  (2023-02-15T17:58:10Z)
• A crowdsourced dataset of aerial images with annotated solar photovoltaic arrays and installation metadata [0.0]
  We propose a dataset containing aerial images, annotations, and segmentation masks. We provide installation metadata for more than 28,000 installations. We provide ground truth segmentation masks for 13,000 installations, including 7,000 with annotations for two different image providers. Finally, we provide installation metadata that matches the annotation for more than 8,000 installations.
  arXiv  Detail & Related papers  (2022-09-08T11:42:53Z)
• DeepSolar tracker: towards unsupervised assessment with open-source data of the accuracy of deep learning-based distributed PV mapping [0.0]
  We build on existing work to propose an automated PV registry pipeline. This pipeline automatically generates a dataset recording all distributed PV installations' location, area, installed capacity, and tilt angle. We propose an unsupervised method based on the it Registre national d'installation (RNI), that centralizes all individual PV systems aggregated at communal level. We deploy our model on 9 French it d'epartements covering more than 50 000 square kilometers, providing the largest mapping of distributed PV panels with this level of detail to date.
  arXiv  Detail & Related papers  (2022-07-15T13:23:24Z)
• CellDefectNet: A Machine-designed Attention Condenser Network for Electroluminescence-based Photovoltaic Cell Defect Inspection [67.99623869339919]
  A big challenge faced by industry in photovoltaic cell visual inspection is the fact that it is currently done manually by human inspectors. In this work, we introduce CellDefectNet, a highly efficient attention condenser network designed via machine-driven design exploration. We demonstrate the efficacy of CellDefectNet on a benchmark dataset comprising of a diversity of photovoltaic cells captured using electroluminescence imagery.
  arXiv  Detail & Related papers  (2022-04-25T16:35:19Z)
• Georeferencing of Photovoltaic Modules from Aerial Infrared Videos using Structure-from-Motion [0.0]
  We use structure-from-motion to automatically obtain geocoordinates of all PV modules in a plant based on visual cues and the measured GPS trajectory of the drone. We successfully map 99.3 % of the 35084 modules in four large-scale and one rooftop plant and extract over 2.2 million module images.
  arXiv  Detail & Related papers  (2022-04-06T11:17:08Z)
• ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and Beyond [76.35955924137986]
  We propose a Vision Transformer Advanced by Exploring intrinsic IB from convolutions, i.e., ViTAE. ViTAE has several spatial pyramid reduction modules to downsample and embed the input image into tokens with rich multi-scale context. We obtain the state-of-the-art classification performance, i.e., 88.5% Top-1 classification accuracy on ImageNet validation set and the best 91.2% Top-1 accuracy on ImageNet real validation set.
  arXiv  Detail & Related papers  (2022-02-21T10:40:05Z)
• Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning [4.409996772486956]
  We train a ResNet-34 convolutional neural network with a supervised contrastive loss to detect anomalies in infrared images. Our method converges quickly and reliably detects unknown types of anomalies making it well suited for practice. Our work serves the community with a more realistic view on PV module fault detection using unsupervised domain adaptation.
  arXiv  Detail & Related papers  (2021-12-06T10:42:28Z)
• A Multi-Stage model based on YOLOv3 for defect detection in PV panels based on IR and Visible Imaging by Unmanned Aerial Vehicle [65.99880594435643]
  We propose a novel model to detect panel defects on aerial images captured by unmanned aerial vehicle. The model combines detections of panels and defects to refine its accuracy. The proposed model has been validated on two big PV plants in the south of Italy.
  arXiv  Detail & Related papers  (2021-11-23T08:04:32Z)
• ViDT: An Efficient and Effective Fully Transformer-based Object Detector [97.71746903042968]
  Detection transformers are the first fully end-to-end learning systems for object detection. vision transformers are the first fully transformer-based architecture for image classification. In this paper, we integrate Vision and Detection Transformers (ViDT) to build an effective and efficient object detector.
  arXiv  Detail & Related papers  (2021-10-08T06:32:05Z)
• Efficient Vision Transformers via Fine-Grained Manifold Distillation [96.50513363752836]
  Vision transformer architectures have shown extraordinary performance on many computer vision tasks. Although the network performance is boosted, transformers are often required more computational resources. We propose to excavate useful information from the teacher transformer through the relationship between images and the divided patches.
  arXiv  Detail & Related papers  (2021-07-03T08:28:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.