Photovoltaic Defect Image Generator with Boundary Alignment Smoothing Constraint for Domain Shift Mitigation

• URL: http://arxiv.org/abs/2505.06117v1
• Date: Fri, 09 May 2025 15:16:42 GMT
• Title: Photovoltaic Defect Image Generator with Boundary Alignment Smoothing Constraint for Domain Shift Mitigation
• Abstract summary: We propose PDIG, a Photovoltaic Defect Image Generator based on Stable Diffusion (SD)<n>PDIG leverages the strong priors learned from large-scale datasets to enhance generation quality under limited data.<n>Our approach improves Frechet Inception Distance (FID) by 19.16 points over the second-best method.
• Score: 7.166413857036151
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate defect detection of photovoltaic (PV) cells is critical for ensuring quality and efficiency in intelligent PV manufacturing systems. However, the scarcity of rich defect data poses substantial challenges for effective model training. While existing methods have explored generative models to augment datasets, they often suffer from instability, limited diversity, and domain shifts. To address these issues, we propose PDIG, a Photovoltaic Defect Image Generator based on Stable Diffusion (SD). PDIG leverages the strong priors learned from large-scale datasets to enhance generation quality under limited data. Specifically, we introduce a Semantic Concept Embedding (SCE) module that incorporates text-conditioned priors to capture the relational concepts between defect types and their appearances. To further enrich the domain distribution, we design a Lightweight Industrial Style Adaptor (LISA), which injects industrial defect characteristics into the SD model through cross-disentangled attention. At inference, we propose a Text-Image Dual-Space Constraints (TIDSC) module, enforcing the quality of generated images via positional consistency and spatial smoothing alignment. Extensive experiments demonstrate that PDIG achieves superior realism and diversity compared to state-of-the-art methods. Specifically, our approach improves Frechet Inception Distance (FID) by 19.16 points over the second-best method and significantly enhances the performance of downstream defect detection tasks.

Related papers

• A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules [24.555237080546885]
  We introduce Generative Defect Isolation (GDI) to disentangle visual features for specific defect types.<n>Experiments on Vision Transformer (ViT-S) and EfficientNetV2-L architectures demonstrate that GDI significantly outperforms baselines.<n>GDI effectively resolves learning ambiguity from co-occurring defects, yielding a 26% reduction in such co-occurring classification errors.
  arXiv  Detail & Related papers  (2026-08-13T02:12:57Z)
• Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback [51.08692072066352]
  Text-to-image (T2I) models still exhibit localized, subtle, and structurally complex failures.<n>Structured Defect Grounding casts T2I diagnosis as structured set prediction by modeling each defect as a location, type, reason, importance.<n>Our detector outperforms leading proprietary VLMs on structured defect grounding.
  arXiv  Detail & Related papers  (2026-06-04T13:03:16Z)
• Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers [57.54843029965778]
  Controllable pathology image synthesis requires reliable regulation of spatial layout, tissue morphology, and semantic detail.<n>We propose In-Context Diffusion Transformer (IC-DiT), a layout-aware generative model that incorporates spatial layouts, textual descriptions, and visual embeddings into a unified diffusion transformer.<n>IC-DiT achieves higher fidelity, stronger spatial controllability, and better diagnostic consistency than existing methods.
  arXiv  Detail & Related papers  (2026-03-11T06:14:11Z)
• Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method [0.0]
  Substation meters play a critical role in monitoring and ensuring the stable operation of power grids.<n>Their detection of cracks and other physical defects is often hampered by a severe scarcity of annotated samples.<n>We propose a novel framework that integrates Conditional Knowledge Embedding and Hypernetwork-Guided Control into a Stable Diffusion pipeline.
  arXiv  Detail & Related papers  (2026-01-14T07:21:57Z)
• Training-Free Generation of Diverse and High-Fidelity Images via Prompt Semantic Space Optimization [50.5332987313297]
  We propose Token-Prompt embedding Space Optimization (TPSO), a training-free and model-agnostic module.<n>TPSO introduces learnable parameters to explore underrepresented regions of the token embedding space, reducing the tendency of the model to repeatedly generate samples from strong modes of the learned distribution.<n>In experiments on MS-COCO and three diffusion backbones, TPSO significantly enhances generative diversity, improving baseline performance from 1.10 to 4.18 points, without sacrificing image quality.
  arXiv  Detail & Related papers  (2025-11-25T00:42:09Z)
• A Dual-Branch CNN for Robust Detection of AI-Generated Facial Forgeries [4.313893060699182]
  Face forgery techniques pose significant threats to AI security, digital media integrity, and public trust.<n>We propose a novel dual-branch convolutional neural network for face forgery detection.<n>We evaluate our model on the DiFF benchmark, which includes forged images generated from four representative methods.
  arXiv  Detail & Related papers  (2025-10-28T17:06:40Z)
• Power Battery Detection [91.99787495748218]
  Power batteries are essential components in electric vehicles, where internal structural defects can pose serious safety risks.<n>We conduct a comprehensive study on power battery detection (PBD), which aims to localize the dense endpoints of cathode and anode plates from X-ray images for quality inspection.<n>We present PBD5K, the first large-scale benchmark for this task, consisting of 5,000 X-ray images from nine battery types with fine-grained annotations and eight types of real-world visual interference.
  arXiv  Detail & Related papers  (2025-08-11T09:35:25Z)
• Solving Inverse Problems with FLAIR [59.02385492199431]
  Flow-based latent generative models are able to generate images with remarkable quality, even enabling text-to-image generation.<n>We present FLAIR, a novel training free variational framework that leverages flow-based generative models as a prior for inverse problems.<n>Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity.
  arXiv  Detail & Related papers  (2025-06-03T09:29:47Z)
• EIAD: Explainable Industrial Anomaly Detection Via Multi-Modal Large Language Models [23.898938659720503]
  Industrial Anomaly Detection (IAD) is critical to ensure product quality during manufacturing.<n>We propose a novel approach that introduces a dedicated multi-modal defect localization module to decouple the dialog functionality from the core feature extraction.<n>We also contribute to the first multi-modal industrial anomaly detection training dataset, named Defect Detection Question Answering (DDQA)
  arXiv  Detail & Related papers  (2025-03-18T11:33:29Z)
• Synthetic Data is an Elegant GIFT for Continual Vision-Language Models [52.343627275005026]
  GIFT is a novel continual fine-tuning approach to overcome catastrophic forgetting in Vision-Language Models.<n>We employ a pre-trained diffusion model to recreate both pre-training and learned downstream task data.<n>Our method consistently outperforms previous state-of-the-art approaches across various settings.
  arXiv  Detail & Related papers  (2025-03-06T09:09:18Z)
• Multi-Modality Driven LoRA for Adverse Condition Depth Estimation [61.525312117638116]
  We propose Multi-Modality Driven LoRA (MMD-LoRA) for Adverse Condition Depth Estimation.<n>It consists of two core components: Prompt Driven Domain Alignment (PDDA) and Visual-Text Consistent Contrastive Learning (VTCCL)<n>It achieves state-of-the-art performance on the nuScenes and Oxford RobotCar datasets.
  arXiv  Detail & Related papers  (2024-12-28T14:23:58Z)
• Bring the Power of Diffusion Model to Defect Detection [0.0]
  diffusion probabilistic model (DDPM) is pre-trained to extract the features of denoising process to construct as a feature repository. The queried latent features are reconstructed and filtered to obtain high-dimensional DDPM features. Experiment results demonstrate that our method achieves competitive results on several industrial datasets.
  arXiv  Detail & Related papers  (2024-08-25T14:28:49Z)
• Looking for Tiny Defects via Forward-Backward Feature Transfer [12.442574943138794]
  We introduce a novel benchmark that evaluates methods on the original, high-resolution image and ground-truth masks. Our benchmark includes a metric that captures robustness with respect to defect size. Our proposal features the highest robustness to defect size, runs at the fastest speed and yields state-of-the-art segmentation performance.
  arXiv  Detail & Related papers  (2024-07-04T17:59:26Z)
• Progressive Alignment with VLM-LLM Feature to Augment Defect Classification for the ASE Dataset [7.1083241462091165]
  Traditional defect classification approaches are facing with two barriers. Insufficient training data and unstable data quality. We propose the special dataset, including rich data description recorded on image, for defect classification, but the defect feature is uneasy to learn directly.
  arXiv  Detail & Related papers  (2024-04-08T04:17:27Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• CINFormer: Transformer network with multi-stage CNN feature injection for surface defect segmentation [73.02218479926469]
  We propose a transformer network with multi-stage CNN feature injection for surface defect segmentation. CINFormer presents a simple yet effective feature integration mechanism that injects the multi-level CNN features of the input image into different stages of the transformer network in the encoder. In addition, CINFormer presents a Top-K self-attention module to focus on tokens with more important information about the defects.
  arXiv  Detail & Related papers  (2023-09-22T06:12:02Z)
• Controlling Text-to-Image Diffusion by Orthogonal Finetuning [74.21549380288631]
  We introduce a principled finetuning method -- Orthogonal Finetuning (OFT) for adapting text-to-image diffusion models to downstream tasks. Unlike existing methods, OFT can provably preserve hyperspherical energy which characterizes the pairwise neuron relationship on the unit hypersphere. We empirically show that our OFT framework outperforms existing methods in generation quality and convergence speed.
  arXiv  Detail & Related papers  (2023-06-12T17:59:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.