Georeferencing of Photovoltaic Modules from Aerial Infrared Videos using Structure-from-Motion

• URL: http://arxiv.org/abs/2204.02733v1
• Date: Wed, 6 Apr 2022 11:17:08 GMT
• Title: Georeferencing of Photovoltaic Modules from Aerial Infrared Videos using Structure-from-Motion
• Authors: Lukas Bommes and Claudia Buerhop-Lutz and Tobias Pickel and Jens Hauch and Christoph Brabec and Ian Marius Peters
• Abstract summary: We use structure-from-motion to automatically obtain geocoordinates of all PV modules in a plant based on visual cues and the measured GPS trajectory of the drone. We successfully map 99.3 % of the 35084 modules in four large-scale and one rooftop plant and extract over 2.2 million module images.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: To identify abnormal photovoltaic (PV) modules in large-scale PV plants economically, drone-mounted infrared (IR) cameras and automated video processing algorithms are frequently used. While most related works focus on the detection of abnormal modules, little has been done to automatically localize those modules within the plant. In this work, we use incremental structure-from-motion to automatically obtain geocoordinates of all PV modules in a plant based on visual cues and the measured GPS trajectory of the drone. In addition, we extract multiple IR images of each PV module. Using our method, we successfully map 99.3 % of the 35084 modules in four large-scale and one rooftop plant and extract over 2.2 million module images. As compared to our previous work, extraction misses 18 times less modules (one in 140 modules as compared to one in eight). Furthermore, two or three plant rows can be processed simultaneously, increasing module throughput and reducing flight duration by a factor of 2.1 and 3.7, respectively. Comparison with an accurate orthophoto of one of the large-scale plants yields a root mean square error of the estimated module geocoordinates of 5.87 m and a relative error within each plant row of 0.22 m to 0.82 m. Finally, we use the module geocoordinates and extracted IR images to visualize distributions of module temperatures and anomaly predictions of a deep learning classifier on a map. While the temperature distribution helps to identify disconnected strings, we also find that its detection accuracy for module anomalies reaches, or even exceeds, that of a deep learning classifier for seven out of ten common anomaly types. The software is published at https://github.com/LukasBommes/PV-Hawk.

Related papers

• HCF-Net: Hierarchical Context Fusion Network for Infrared Small Object Detection [16.92362922379821]
  We propose a deep learning method to improve infrared small object detection performance. The method includes the parallelized patch-aware attention (PPA) module, dimension-aware selective integration (DASI) module, and multi-dilated channel refiner (MDCR) module.
  arXiv  Detail & Related papers  (2024-03-16T02:45:42Z)
• LeTFuser: Light-weight End-to-end Transformer-Based Sensor Fusion for Autonomous Driving with Multi-Task Learning [16.241116794114525]
  We introduce LeTFuser, an algorithm for fusing multiple RGB-D camera representations. To perform perception and control tasks simultaneously, we utilize multi-task learning.
  arXiv  Detail & Related papers  (2023-10-19T20:09:08Z)
• UnLoc: A Universal Localization Method for Autonomous Vehicles using LiDAR, Radar and/or Camera Input [51.150605800173366]
  UnLoc is a novel unified neural modeling approach for localization with multi-sensor input in all weather conditions. Our method is extensively evaluated on Oxford Radar RobotCar, ApolloSouthBay and Perth-WA datasets.
  arXiv  Detail & Related papers  (2023-07-03T04:10:55Z)
• Anomaly Detection in IR Images of PV Modules using Supervised Contrastive Learning [4.409996772486956]
  We train a ResNet-34 convolutional neural network with a supervised contrastive loss to detect anomalies in infrared images. Our method converges quickly and reliably detects unknown types of anomalies making it well suited for practice. Our work serves the community with a more realistic view on PV module fault detection using unsupervised domain adaptation.
  arXiv  Detail & Related papers  (2021-12-06T10:42:28Z)
• A Multi-Stage model based on YOLOv3 for defect detection in PV panels based on IR and Visible Imaging by Unmanned Aerial Vehicle [65.99880594435643]
  We propose a novel model to detect panel defects on aerial images captured by unmanned aerial vehicle. The model combines detections of panels and defects to refine its accuracy. The proposed model has been validated on two big PV plants in the south of Italy.
  arXiv  Detail & Related papers  (2021-11-23T08:04:32Z)
• Infrared Small-Dim Target Detection with Transformer under Complex Backgrounds [155.388487263872]
  We propose a new infrared small-dim target detection method with the transformer. We adopt the self-attention mechanism of the transformer to learn the interaction information of image features in a larger range. We also design a feature enhancement module to learn more features of small-dim targets.
  arXiv  Detail & Related papers  (2021-09-29T12:23:41Z)
• Computer Vision Tool for Detection, Mapping and Fault Classification of PV Modules in Aerial IR Videos [0.0]
  We develop a computer vision tool for the semi-automatic extraction of PV modules from thermographic UAV videos. We use it to curate a dataset containing 4.3 million IR images of 107842 PV modules from thermographic videos of seven different PV plants.
  arXiv  Detail & Related papers  (2021-06-14T11:38:13Z)
• Know Your Surroundings: Panoramic Multi-Object Tracking by Multimodality Collaboration [56.01625477187448]
  We propose a MultiModality PAnoramic multi-object Tracking framework (MMPAT) It takes both 2D panorama images and 3D point clouds as input and then infers target trajectories using the multimodality data. We evaluate the proposed method on the JRDB dataset, where the MMPAT achieves the top performance in both the detection and tracking tasks.
  arXiv  Detail & Related papers  (2021-05-31T03:16:38Z)
• Deep Learning-based Pipeline for Module Power Prediction from EL Measurements [7.0282423213545195]
  In this work, we bridge the gap between electroluminescense measurements and the power determination of a module. We compile a large dataset of 719 electroluminescense measurementsof modules at various stages of degradation. We propose a variant of class activation maps to obtain the per cell power loss, as predicted by the model.
  arXiv  Detail & Related papers  (2020-09-30T14:46:47Z)
• PerMO: Perceiving More at Once from a Single Image for Autonomous Driving [76.35684439949094]
  We present a novel approach to detect, segment, and reconstruct complete textured 3D models of vehicles from a single image. Our approach combines the strengths of deep learning and the elegance of traditional techniques. We have integrated these algorithms with an autonomous driving system.
  arXiv  Detail & Related papers  (2020-07-16T05:02:45Z)
• TAM: Temporal Adaptive Module for Video Recognition [60.83208364110288]
  temporal adaptive module (bf TAM) generates video-specific temporal kernels based on its own feature map. Experiments on Kinetics-400 and Something-Something datasets demonstrate that our TAM outperforms other temporal modeling methods consistently.
  arXiv  Detail & Related papers  (2020-05-14T08:22:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.