Improving the Segmentation of Scanning Probe Microscope Images using Convolutional Neural Networks

• URL: http://arxiv.org/abs/2008.12371v1
• Date: Thu, 27 Aug 2020 20:49:59 GMT
• Title: Improving the Segmentation of Scanning Probe Microscope Images using Convolutional Neural Networks
• Authors: Steff Farley, Jo E.A. Hodgkinson, Oliver M. Gordon, Joanna Turner, Andrea Soltoggio, Philip J. Moriarty, Eugenie Hunsicker
• Abstract summary: We develop protocols for the segmentation of images of 2D assemblies of gold nanoparticles formed on silicon surfaces via deposition from an organic solvent. The evaporation of the solvent drives far-from-equilibrium self-organisation of the particles, producing a wide variety of nano- and micro-structured patterns. We show that a segmentation strategy using the U-Net convolutional neural network outperforms traditional automated approaches.
• Score: 0.9236074230806579
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: A wide range of techniques can be considered for segmentation of images of nanostructured surfaces. Manually segmenting these images is time-consuming and results in a user-dependent segmentation bias, while there is currently no consensus on the best automated segmentation methods for particular techniques, image classes, and samples. Any image segmentation approach must minimise the noise in the images to ensure accurate and meaningful statistical analysis can be carried out. Here we develop protocols for the segmentation of images of 2D assemblies of gold nanoparticles formed on silicon surfaces via deposition from an organic solvent. The evaporation of the solvent drives far-from-equilibrium self-organisation of the particles, producing a wide variety of nano- and micro-structured patterns. We show that a segmentation strategy using the U-Net convolutional neural network outperforms traditional automated approaches and has particular potential in the processing of images of nanostructured systems.

Related papers

• Advanced Image Segmentation Techniques for Neural Activity Detection via C-fos Immediate Early Gene Expression [0.0]
  We develop a novel workflow for the segmentation process involving Convolutional Neural Networks (CNNs) and the Unet model. We demonstrate the effectiveness of our method in distinguishing areas with significant C-fos expression from normal tissue areas.
  arXiv  Detail & Related papers  (2023-12-13T14:36:16Z)
• Recursive Detection and Analysis of Nanoparticles in Scanning Electron Microscopy Images [0.0]
  We present a computational framework tailored for the precise detection and comprehensive analysis of nanoparticles within scanning electron microscopy (SEM) images. The framework employs the robust image processing capabilities of Python, particularly harnessing libraries such as OpenCV, SciPy, and Scikit-Image. It boasts 97% accuracy in detecting particles across five distinct test images drawn from a SEM nanoparticles dataset.
  arXiv  Detail & Related papers  (2023-08-17T02:08:05Z)
• Two Approaches to Supervised Image Segmentation [55.616364225463066]
  The present work develops comparison experiments between deep learning and multiset neurons approaches. The deep learning approach confirmed its potential for performing image segmentation. The alternative multiset methodology allowed for enhanced accuracy while requiring little computational resources.
  arXiv  Detail & Related papers  (2023-07-19T16:42:52Z)
• GM-NeRF: Learning Generalizable Model-based Neural Radiance Fields from Multi-view Images [79.39247661907397]
  We introduce an effective framework Generalizable Model-based Neural Radiance Fields to synthesize free-viewpoint images. Specifically, we propose a geometry-guided attention mechanism to register the appearance code from multi-view 2D images to a geometry proxy.
  arXiv  Detail & Related papers  (2023-03-24T03:32:02Z)
• Automated Classification of Nanoparticles with Various Ultrastructures and Sizes [0.6927055673104933]
  We present a deep-learning based method for nanoparticles measurement and classification trained from a small data set of scanning transmission electron microscopy images. Our approach is comprised of two stages: localization, i.e., detection of nanoparticles, and classification, i.e., categorization of their ultrastructure. We show how the generation of synthetic images, either using image processing or using various image generation neural networks, can be used to improve the results in both stages.
  arXiv  Detail & Related papers  (2022-07-28T11:31:43Z)
• Understanding the Influence of Receptive Field and Network Complexity in Neural-Network-Guided TEM Image Analysis [0.0]
  We systematically examine how neural network architecture choices affect how neural networks segment in transmission electron microscopy (TEM) images. We find that for low-resolution TEM images which rely on amplitude contrast to distinguish nanoparticles from background, the receptive field does not significantly influence segmentation performance. On the other hand, for high-resolution TEM images which rely on a combination of amplitude and phase contrast changes to identify nanoparticles, receptive field is a key parameter for increased performance.
  arXiv  Detail & Related papers  (2022-04-08T18:45:15Z)
• Sharp-GAN: Sharpness Loss Regularized GAN for Histopathology Image Synthesis [65.47507533905188]
  Conditional generative adversarial networks have been applied to generate synthetic histopathology images. We propose a sharpness loss regularized generative adversarial network to synthesize realistic histopathology images.
  arXiv  Detail & Related papers  (2021-10-27T18:54:25Z)
• Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising [104.59305271099967]
  We present a pixel aggregation network and learn the pixel sampling and averaging strategies for image denoising. We develop a pixel aggregation network for video denoising to sample pixels across the spatial-temporal space. Our method is able to solve the misalignment issues caused by large motion in dynamic scenes.
  arXiv  Detail & Related papers  (2021-01-26T13:00:46Z)
• Unsupervised Instance Segmentation in Microscopy Images via Panoptic Domain Adaptation and Task Re-weighting [86.33696045574692]
  We propose a Cycle Consistency Panoptic Domain Adaptive Mask R-CNN (CyC-PDAM) architecture for unsupervised nuclei segmentation in histopathology images. We first propose a nuclei inpainting mechanism to remove the auxiliary generated objects in the synthesized images. Secondly, a semantic branch with a domain discriminator is designed to achieve panoptic-level domain adaptation.
  arXiv  Detail & Related papers  (2020-05-05T11:08:26Z)
• Pathological Retinal Region Segmentation From OCT Images Using Geometric Relation Based Augmentation [84.7571086566595]
  We propose improvements over previous GAN-based medical image synthesis methods by jointly encoding the intrinsic relationship of geometry and shape. The proposed method outperforms state-of-the-art segmentation methods on the public RETOUCH dataset having images captured from different acquisition procedures.
  arXiv  Detail & Related papers  (2020-03-31T11:50:43Z)
• Machine Learning Pipeline for Segmentation and Defect Identification from High Resolution Transmission Electron Microscopy Data [0.0]
  We demonstrate a flexible two step pipeline for analysis of high resolution transmission electron microscopy data. Our trained U-Net is able to segment nanoparticles from amorphous background with a Dice coefficient of 0.8. We are then able to classify whether nanoparticles contain a visible stacking fault with 86% accuracy.
  arXiv  Detail & Related papers  (2020-01-14T19:49:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.