PV-S3: Advancing Automatic Photovoltaic Defect Detection using Semi-Supervised Semantic Segmentation of Electroluminescence Images
- URL: http://arxiv.org/abs/2404.13693v2
- Date: Wed, 17 Jul 2024 16:33:03 GMT
- Title: PV-S3: Advancing Automatic Photovoltaic Defect Detection using Semi-Supervised Semantic Segmentation of Electroluminescence Images
- Authors: Abhishek Jha, Yogesh Rawat, Shruti Vyas,
- Abstract summary: Traditional health check using Electroluminescence (EL) imaging is expensive and logistically challenging.
Current automation approaches require extensive manual expert labeling, which is time-consuming, expensive, and prone to errors.
We propose PV-S3 (Photovoltaic-Supervised Supervised), a Semi-Supervised Learning approach for semantic segmentation of defects in EL images.
- Score: 5.42097399791863
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Photovoltaic (PV) systems allow us to tap into all abundant solar energy, however they require regular maintenance for high efficiency and to prevent degradation. Traditional manual health check, using Electroluminescence (EL) imaging, is expensive and logistically challenging which makes automated defect detection essential. Current automation approaches require extensive manual expert labeling, which is time-consuming, expensive, and prone to errors. We propose PV-S3 (Photovoltaic-Semi Supervised Segmentation), a Semi-Supervised Learning approach for semantic segmentation of defects in EL images that reduces reliance on extensive labeling. PV-S3 is a Deep learning model trained using a few labeled images along with numerous unlabeled images. We evaluate PV-S3 on multiple datasets and demonstrate its effectiveness and adaptability. With merely 20% labeled samples, we achieve an absolute improvement of 9.7% in IoU, 13.5% in Precision, 29.15% in Recall, and 20.42% in F1-Score over prior state-of-the-art supervised method (which uses 100% labeled samples) on UCF-EL dataset (largest dataset available for semantic segmentation of EL images)showing improvement in performance while reducing the annotation costs by 80%.
Related papers
- Raising the Bar of AI-generated Image Detection with CLIP [50.345365081177555]
The aim of this work is to explore the potential of pre-trained vision-language models (VLMs) for universal detection of AI-generated images.
We develop a lightweight detection strategy based on CLIP features and study its performance in a wide variety of challenging scenarios.
arXiv Detail & Related papers (2023-11-30T21:11:20Z) - Noise Self-Regression: A New Learning Paradigm to Enhance Low-Light Images Without Task-Related Data [86.68013790656762]
We propose Noise SElf-Regression (NoiSER) without access to any task-related data.
NoiSER is highly competitive in enhancement quality, yet with a much smaller model size, and much lower training and inference cost.
arXiv Detail & Related papers (2022-11-09T06:18:18Z) - Fix-A-Step: Semi-supervised Learning from Uncurated Unlabeled Data [4.779633174910461]
In real applications like medical imaging, unlabeled data will be collected for expediency and thus uncurated.
We introduce Fix-A-Step, a procedure that views all uncurated unlabeled images as potentially helpful.
On a new medical SSL benchmark called Heart2Heart, Fix-A-Step can learn from 353,500 truly uncurated ultrasound images to deliver gains that generalize across hospitals.
arXiv Detail & Related papers (2022-08-25T04:52:21Z) - Seamless Iterative Semi-Supervised Correction of Imperfect Labels in
Microscopy Images [57.42492501915773]
In-vitro tests are an alternative to animal testing for the toxicity of medical devices.
Human fatigue plays a role in error making, making the use of deep learning appealing.
We propose Seamless Iterative Semi-Supervised correction of Imperfect labels (SISSI)
Our method successfully provides an adaptive early learning correction technique for object detection.
arXiv Detail & Related papers (2022-08-05T18:52:20Z) - Masked Unsupervised Self-training for Zero-shot Image Classification [98.23094305347709]
Masked Unsupervised Self-Training (MUST) is a new approach which leverages two different and complimentary sources of supervision: pseudo-labels and raw images.
MUST improves upon CLIP by a large margin and narrows the performance gap between unsupervised and supervised classification.
arXiv Detail & Related papers (2022-06-07T02:03:06Z) - CellDefectNet: A Machine-designed Attention Condenser Network for
Electroluminescence-based Photovoltaic Cell Defect Inspection [67.99623869339919]
A big challenge faced by industry in photovoltaic cell visual inspection is the fact that it is currently done manually by human inspectors.
In this work, we introduce CellDefectNet, a highly efficient attention condenser network designed via machine-driven design exploration.
We demonstrate the efficacy of CellDefectNet on a benchmark dataset comprising of a diversity of photovoltaic cells captured using electroluminescence imagery.
arXiv Detail & Related papers (2022-04-25T16:35:19Z) - Unified Contrastive Learning in Image-Text-Label Space [130.31947133453406]
Unified Contrastive Learning (UniCL) is effective way of learning semantically rich yet discriminative representations.
UniCL stand-alone is a good learner on pure imagelabel data, rivaling the supervised learning methods across three image classification datasets.
arXiv Detail & Related papers (2022-04-07T17:34:51Z) - Anomaly Detection in IR Images of PV Modules using Supervised
Contrastive Learning [4.409996772486956]
We train a ResNet-34 convolutional neural network with a supervised contrastive loss to detect anomalies in infrared images.
Our method converges quickly and reliably detects unknown types of anomalies making it well suited for practice.
Our work serves the community with a more realistic view on PV module fault detection using unsupervised domain adaptation.
arXiv Detail & Related papers (2021-12-06T10:42:28Z) - Segmentation of cell-level anomalies in electroluminescence images of
photovoltaic modules [0.0]
We propose an end-to-end deep learning pipeline that detects, locates and segments cell-level anomalies from entire photovoltaic modules.
The proposed modular pipeline combines three deep learning techniques: 1. object detection (modified Faster-RNN), 2. image classification (EfficientNet) and 3. weakly supervised segmentation (autoencoder)
arXiv Detail & Related papers (2021-06-21T10:17:40Z) - Few Shot Learning Framework to Reduce Inter-observer Variability in
Medical Images [1.2335698325757494]
Quality assuring large volumes of annotated medical image data can be subjective and expensive.
We present a novel standardization framework that implements three few-shot learning (FSL) models.
We also propose a novel target label selection algorithm (TLSA) that measures relative agreeability between RPs and the manually annotated target labels.
arXiv Detail & Related papers (2020-08-07T02:05:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.