Automated and Scalable SEM Image Analysis of Perovskite Solar Cell Materials via a Deep Segmentation Framework

• URL: http://arxiv.org/abs/2509.26548v1
• Date: Tue, 30 Sep 2025 17:18:51 GMT
• Title: Automated and Scalable SEM Image Analysis of Perovskite Solar Cell Materials via a Deep Segmentation Framework
• Abstract summary: We present an automated deep learning-based framework for SEM image segmentation.<n>Our model named PerovSegNet incorporates two novel modules.<n>PerovSegNet achieves a mean Average Precision of 87.25% with 265.4 Giga Floating Point Operations.
• Score: 6.6168431490300845
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Scanning Electron Microscopy (SEM) is indispensable for characterizing the microstructure of thin films during perovskite solar cell fabrication. Accurate identification and quantification of lead iodide and perovskite phases are critical because residual lead iodide strongly influences crystallization pathways and defect formation, while the morphology of perovskite grains governs carrier transport and device stability. Yet current SEM image analysis is still largely manual, limiting throughput and consistency. Here, we present an automated deep learning-based framework for SEM image segmentation that enables precise and efficient identification of lead iodide, perovskite and defect domains across diverse morphologies. Built upon an improved YOLOv8x architecture, our model named PerovSegNet incorporates two novel modules: (i) Adaptive Shuffle Dilated Convolution Block, which enhances multi-scale and fine-grained feature extraction through group convolutions and channel mixing; and (ii) Separable Adaptive Downsampling module, which jointly preserves fine-scale textures and large-scale structures for more robust boundary recognition. Trained on an augmented dataset of 10,994 SEM images, PerovSegNet achieves a mean Average Precision of 87.25% with 265.4 Giga Floating Point Operations, outperforming the baseline YOLOv8x-seg by 4.08%, while reducing model size and computational load by 24.43% and 25.22%, respectively. Beyond segmentation, the framework provides quantitative grain-level metrics, such as lead iodide/perovskite area and count, which can serve as reliable indicators of crystallization efficiency and microstructural quality. These capabilities establish PerovSegNet as a scalable tool for real-time process monitoring and data-driven optimization of perovskite thin-film fabrication.The source code is available at:https://github.com/wlyyj/PerovSegNet/tree/master.

Related papers

• Enhancing EBSD throughput of battery electrode materials using super-resolution generative adversarial networks [0.0]
  This work demonstrates a machine learning super-resolution framework using a generative adversarial network (SRGAN) to significantly increase EBSD throughput.<n>The SRGAN model was trained on EBSD data of LiNixMnyCozO2 cathode particles to enhance low-resolution datasets.<n>We demonstrate that a 5x upscaling factor, corresponding to a 25x speed-up in acquisition time or a 25x larger field of view, is practical while maintaining acceptable accuracy in key metrics like grain size and shape.
  arXiv  Detail & Related papers  (2026-08-19T17:14:20Z)
• Accurate identification and measurement of the precipitate area by two-stage deep neural networks in novel chromium-based alloys [43.18932499199212]
  Development of chromium-based superalloys requires efficient measurement of precipitate volume fraction and size distribution.<n>Traditional fixed-threshold image processing is sensitive to background noise, generalises poorly across materials, and requires substantial manual measurement effort.<n>This study proposes DT-SegNet, an end-to-end two-stage deep learning scheme based on YOLOv5 and SegFormer for object detection and segmentation in electron microscopy images.
  arXiv  Detail & Related papers  (2026-06-20T15:50:58Z)
• SCRWKV: Ultra-Compact Structure-Calibrated Vision-RWKV for Topological Crack Segmentation [36.61448234263959]
  We propose the Ultra-Compact Structure-Calibrated Vision RWKV (SCRWKV) to achieve pixel-level accurate segmentation of structural cracks.<n>The network achieves high-precision modeling via a novel Structure-Field backbone while maintaining linear complexity.<n>We show that SCRWKV, with only 1.22M parameters, significantly outperforms SOTA methods.
  arXiv  Detail & Related papers  (2026-05-14T15:01:22Z)
• SCALE:Scalable Conditional Atlas-Level Endpoint transport for virtual cell perturbation prediction [46.645872209565574]
  We present a specialized large-scale foundation model for virtual cell perturbation prediction.<n>First, we build a BioNeMo-based training and inference framework that substantially improves data throughput.<n>Second, we formulate perturbation prediction as conditional transport and implement it with a set-aware flow architecture.<n>Third, we evaluate the model on Tahoe-100M using a rigorous cell-level protocol centered on biologically meaningful metrics.
  arXiv  Detail & Related papers  (2026-03-18T05:51:08Z)
• Accurate Network Traffic Matrix Prediction via LEAD: a Large Language Model-Enhanced Adapter-Based Conditional Diffusion Model [41.23125529149133]
  We present LEAD, a conditional Diffusion model that transforms traffic matrices into RGB images.<n>We also propose a Dual-Conditioning Strategy to guide a diffusion model to generate complex, dynamic network traffic.<n>Experiments on the Abilene and GEANT datasets demonstrate that LEAD outperforms all baselines.
  arXiv  Detail & Related papers  (2026-01-29T09:16:05Z)
• Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models [1.8969168959157112]
  This work presents a unified framework leveraging vision foundation models to automate the quantification and classification of CNTs in electron microscopy images.<n>We introduce an interactive quantification tool built on the Segment Anything Model (SAM) that segments particles with near-perfect accuracy using minimal user input.<n>Second, we propose a novel classification pipeline that utilizes these segmentation masks to spatially constrain a DINOv2 vision transformer, extracting features exclusively from particle regions while suppressing background noise.<n> Evaluated on a dataset of 1,800 TEM images, this architecture achieves 95.5% accuracy in distinguishing between four different CNT morphologies, significantly outperforming the current baseline despite using a
  arXiv  Detail & Related papers  (2026-01-10T20:22:58Z)
• Towards Foundation Models for Cryo-ET Subtomogram Analysis [36.85797849551338]
  We introduce CryoEngine, a large-scale synthetic data generator that produces over 904k subtomograms from 452 particle classes for pretraining.<n>Second, we design an Adaptive Phase Tokenization-enhanced Vision Transformer (APT-ViT), which incorporates adaptive phase tokenization as an equivariance-enhancing module.<n>Third, we introduce a Noise-Resilient Contrastive Learning (NRCL) strategy to stabilize representation learning under severe noise conditions.
  arXiv  Detail & Related papers  (2025-09-29T05:47:45Z)
• STEM Diffraction Pattern Analysis with Deep Learning Networks [0.0]
  This work presents a machine learning-based approach for predicting Euler angles directly from scanning transmission electron microscopy (STEM) diffraction patterns (DPs)<n>It enables the automated generation of high-resolution crystal orientation maps, facilitating the analysis of internal microstructures at the nanoscale.<n>Three deep learning architectures--convolutional neural networks (CNNs), Dense Convolutional Networks (DenseNets), and Shifted Windows (Swin) Transformers--are evaluated, using an experimentally acquired dataset labelled via a commercial TM algorithm.
  arXiv  Detail & Related papers  (2025-07-02T16:58:09Z)
• Process-aware and high-fidelity microstructure generation using stable diffusion [0.8060624778923473]
  We present a novel process-aware generative modeling approach based on Stable Diffusion 3.5 Large (SD3.5-Large)<n>Our method introduces numeric-aware embeddings that encode continuous variables directly into the model's conditioning.<n>We validate realism using a semantic segmentation model based on a fine-tuned U-Net with a VGG16 encoder on 24 labeled micrographs.
  arXiv  Detail & Related papers  (2025-07-01T06:16:53Z)
• Zero-shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials [41.856704526703595]
  characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training.<n>This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training datasets.<n>We present ATOMIC, an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials.
  arXiv  Detail & Related papers  (2025-04-14T14:49:45Z)
• CRISP: A Framework for Cryo-EM Image Segmentation and Processing with Conditional Random Field [0.0]
  We present a pipeline that automatically generates high-quality segmentation maps from cryo-EM data.<n>Our modular framework enables the selection of various segmentation models and loss functions.<n>When trained on a limited set of micrographs, our approach achieves over 90% accuracy, recall, precision, Intersection over Union (IoU) and F1-score on synthetic data.
  arXiv  Detail & Related papers  (2025-02-12T10:44:45Z)
• SAM-EM: Real-Time Segmentation for Automated Liquid Phase Transmission Electron Microscopy [37.81867450552998]
  We present Segment Anything Model for Electron Microscopy (SAM-EM)<n>SAM-EM is a domain-adapted foundation model that unifies segmentation, tracking, and statistical analysis for LPTEM data.<n>Built on Segment Anything Model 2 (SAM2), SAM-EM is derived through full-model fine-tuning on 46,600 curated LPTEM synthetic video frames.
  arXiv  Detail & Related papers  (2025-01-06T17:19:27Z)
• SEMU-Net: A Segmentation-based Corrector for Fabrication Process Variations of Nanophotonics with Microscopic Images [4.875868958100446]
  We introduce SEMU-Net, a set of methods that automatically segments scanning electron microscope images (SEM) and uses them to train two deep neural network models based on U-Net and its variants. The predictor model anticipates fabrication-induced variations, while the corrector model adjusts the design to address these issues. Experimental results show that the segmentation U-Net reaches an average IoU score of 99.30%, while the corrector attention U-Net in a tandem architecture achieves an average IoU score of 98.67%.
  arXiv  Detail & Related papers  (2024-11-25T22:49:59Z)
• KaLDeX: Kalman Filter based Linear Deformable Cross Attention for Retina Vessel Segmentation [46.57880203321858]
  We propose a novel network (KaLDeX) for vascular segmentation leveraging a Kalman filter based linear deformable cross attention (LDCA) module. Our approach is based on two key components: Kalman filter (KF) based linear deformable convolution (LD) and cross-attention (CA) modules. The proposed method is evaluated on retinal fundus image datasets (DRIVE, CHASE_BD1, and STARE) as well as the 3mm and 6mm of the OCTA-500 dataset.
  arXiv  Detail & Related papers  (2024-10-28T16:00:42Z)
• Diffusion Model Driven Test-Time Image Adaptation for Robust Skin Lesion Classification [24.08402880603475]
  We propose a test-time image adaptation method to enhance the accuracy of the model on test data. We modify the target test images by projecting them back to the source domain using a diffusion model. Our method makes the robustness more robust across various corruptions, architectures, and data regimes.
  arXiv  Detail & Related papers  (2024-05-18T13:28:51Z)
• Automated Grain Boundary (GB) Segmentation and Microstructural Analysis in 347H Stainless Steel Using Deep Learning and Multimodal Microscopy [2.0445155106382797]
  Austenitic 347H stainless steel offers superior mechanical properties and corrosion resistance required for extreme operating conditions. CNN based deep-learning models is a powerful technique to detect features from material micrographs in an automated manner. We combine scanning electron microscopy (SEM) images of 347H stainless steel as training data and electron backscatter diffraction (EBSD) micrographs as pixel-wise labels for grain boundary detection.
  arXiv  Detail & Related papers  (2023-05-12T22:49:36Z)
• Neural Network Accelerated Process Design of Polycrystalline Microstructures [23.897115046430635]
  We develop a neural network (NN)-based method with physics-infused constraints to predict microstructural evolution. In this study, our NN-based method is applied to maximize the homogenized stiffness of a Copper microstructure. It is found to be 686 times faster while achieving 0.053% error in the resulting homogenized stiffness compared to the traditional finite element simulator.
  arXiv  Detail & Related papers  (2023-04-11T20:35:29Z)
• Tracking perovskite crystallization via deep learning-based feature detection on 2D X-ray scattering data [137.47124933818066]
  We propose an automated pipeline for the analysis of X-ray diffraction images based on the Faster R-CNN deep learning architecture. We demonstrate our method on real-time tracking of organic-inorganic perovskite structure crystallization and test it on two applications.
  arXiv  Detail & Related papers  (2022-02-22T15:39:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.