A lightweight network for photovoltaic cell defect detection in electroluminescence images based on neural architecture search and knowledge distillation

• URL: http://arxiv.org/abs/2302.07455v1
• Date: Wed, 15 Feb 2023 04:00:35 GMT
• Title: A lightweight network for photovoltaic cell defect detection in electroluminescence images based on neural architecture search and knowledge distillation
• Authors: Jinxia Zhang, Xinyi Chen, Haikun Wei, Kanjian Zhang
• Abstract summary: convolutional neural network (CNN) has been widely used in the existing automatic defect detection of PV cells. We propose a novel lightweight high-performance model for automatic defect detection of PV cells based on neural architecture search and knowledge distillation. The proposed lightweight high-performance model can be easily deployed to the end devices of the actual industrial projects and retain the accuracy.
• Score: 9.784061533539822
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Nowadays, the rapid development of photovoltaic(PV) power stations requires increasingly reliable maintenance and fault diagnosis of PV modules in the field. Due to the effectiveness, convolutional neural network (CNN) has been widely used in the existing automatic defect detection of PV cells. However, the parameters of these CNN-based models are very large, which require stringent hardware resources and it is difficult to be applied in actual industrial projects. To solve these problems, we propose a novel lightweight high-performance model for automatic defect detection of PV cells in electroluminescence(EL) images based on neural architecture search and knowledge distillation. To auto-design an effective lightweight model, we introduce neural architecture search to the field of PV cell defect classification for the first time. Since the defect can be any size, we design a proper search structure of network to better exploit the multi-scale characteristic. To improve the overall performance of the searched lightweight model, we further transfer the knowledge learned by the existing pre-trained large-scale model based on knowledge distillation. Different kinds of knowledge are exploited and transferred, including attention information, feature information, logit information and task-oriented information. Experiments have demonstrated that the proposed model achieves the state-of-the-art performance on the public PV cell dataset of EL images under online data augmentation with accuracy of 91.74% and the parameters of 1.85M. The proposed lightweight high-performance model can be easily deployed to the end devices of the actual industrial projects and retain the accuracy.

Related papers

• Diffusion Model Based Visual Compensation Guidance and Visual Difference Analysis for No-Reference Image Quality Assessment [82.13830107682232]
  We propose a novel class of state-of-the-art (SOTA) generative model, which exhibits the capability to model intricate relationships. We devise a new diffusion restoration network that leverages the produced enhanced image and noise-containing images. Two visual evaluation branches are designed to comprehensively analyze the obtained high-level feature information.
  arXiv  Detail & Related papers  (2024-02-22T09:39:46Z)
• CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation [73.02218479926469]
  We propose a transformer network with multi-stage CNN feature injection for surface defect segmentation. CINFormer presents a simple yet effective feature integration mechanism that injects the multi-level CNN features of the input image into different stages of the transformer network in the encoder. In addition, CINFormer presents a Top-K self-attention module to focus on tokens with more important information about the defects.
  arXiv  Detail & Related papers  (2023-09-22T06:12:02Z)
• Local Distortion Aware Efficient Transformer Adaptation for Image Quality Assessment [62.074473976962835]
  We show that with proper injection of local distortion features, a larger pretrained and fixed foundation model performs better in IQA tasks. Specifically, for the lack of local distortion structure and inductive bias of vision transformer (ViT), we use another pretrained convolution neural network (CNN) We propose a local distortion extractor to obtain local distortion features from the pretrained CNN and a local distortion injector to inject the local distortion features into ViT.
  arXiv  Detail & Related papers  (2023-08-23T08:41:21Z)
• Improving the Timing Resolution of Positron Emission Tomography Detectors Using Boosted Learning -- A Residual Physics Approach [0.4999814847776097]
  This work presents a novel and versatile approach to detector optimization using machine learning (ML) and residual physics. We apply the concept to positron emission tomography (PET), intending to improve the coincidence time resolution (CTR) We were able to improve the CTR significantly (more than 20%) for clinically relevant detectors of 19 mm height, reaching CTRs of 185 ps (450-550 keV)
  arXiv  Detail & Related papers  (2023-02-03T12:10:24Z)
• An Adversarial Active Sampling-based Data Augmentation Framework for Manufacturable Chip Design [55.62660894625669]
  Lithography modeling is a crucial problem in chip design to ensure a chip design mask is manufacturable. Recent developments in machine learning have provided alternative solutions in replacing the time-consuming lithography simulations with deep neural networks. We propose a litho-aware data augmentation framework to resolve the dilemma of limited data and improve the machine learning model performance.
  arXiv  Detail & Related papers  (2022-10-27T20:53:39Z)
• A Fault Detection Scheme Utilizing Convolutional Neural Network for PV Solar Panels with High Accuracy [0.0]
  This paper proposes a trained convolutional neural network based fault detection scheme. For binary classification, the algorithm classifies the input images of PV cells into two categories. The success rate for the proposed CNN model is 91.1% for binary classification and 88.6% for multi-classification.
  arXiv  Detail & Related papers  (2022-10-14T14:19:33Z)
• POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices [8.969089378686299]
  We propose the first-ever Transformer model (POViT) to efficiently design and simulate semiconductor photonic devices. Our work has the potential to drive the expansion of EDA to fully automated photonic design.
  arXiv  Detail & Related papers  (2022-05-17T01:58:34Z)
• CellDefectNet: A Machine-designed Attention Condenser Network for Electroluminescence-based Photovoltaic Cell Defect Inspection [67.99623869339919]
  A big challenge faced by industry in photovoltaic cell visual inspection is the fact that it is currently done manually by human inspectors. In this work, we introduce CellDefectNet, a highly efficient attention condenser network designed via machine-driven design exploration. We demonstrate the efficacy of CellDefectNet on a benchmark dataset comprising of a diversity of photovoltaic cells captured using electroluminescence imagery.
  arXiv  Detail & Related papers  (2022-04-25T16:35:19Z)
• Automated Quality Control of Vacuum Insulated Glazing by Convolutional Neural Network Image Classification [5.2183907457242915]
  We develop, trained, and tested a deep learning computer vision system using convolutional neural networks. The system flawlessly classified the test dataset with an area under the curve (AUC) for the receiver operating characteristic (ROC) of 100%. We employ the state-of-the-art methods Grad-CAM and Score-CAM of explainable Artificial Intelligence (XAI) to provide an understanding of the internal mechanisms.
  arXiv  Detail & Related papers  (2021-10-15T13:10:54Z)
• Cognitive Visual Inspection Service for LCD Manufacturing Industry [80.63336968475889]
  This paper discloses a novel visual inspection system for liquid crystal display (LCD), which is currently a dominant type in the FPD industry. System is based on two cornerstones: robust/high-performance defect recognition model and cognitive visual inspection service architecture.
  arXiv  Detail & Related papers  (2021-01-11T08:14:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.