A Fourier-Based Global Denoising Model for Smart Artifacts Removing of Microscopy Images
- URL: http://arxiv.org/abs/2511.09734v1
- Date: Fri, 14 Nov 2025 01:06:51 GMT
- Title: A Fourier-Based Global Denoising Model for Smart Artifacts Removing of Microscopy Images
- Authors: Huanhuan Zhao, Connor Vernachio, Laxmi Bhurtel, Wooin Yang, Ruben Millan-Solsona, Spenser R. Brown, Marti Checa, Komal Sharma Agrawal, Adam M. Guss, Liam Collins, Wonhee Ko, Arpan Biswas,
- Abstract summary: tuning microscopy controls to obtain a high-quality of images is a non-trivial and time-consuming effort.<n>Existing denoising models mostly build on generalizing the weak signals as noises.<n>We propose a global denoising model (GDM) to smartly remove artifacts of microscopy images while preserving weaker but physically important features.
- Score: 2.7775958728515335
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Microscopy such as Scanning Tunneling Microscopy (STM), Atomic Force Microscopy (AFM) and Scanning Electron Microscopy (SEM) are essential tools in material imaging at micro- and nanoscale resolutions to extract physical knowledge and materials structure-property relationships. However, tuning microscopy controls (e.g. scanning speed, current setpoint, tip bias etc.) to obtain a high-quality of images is a non-trivial and time-consuming effort. On the other hand, with sub-standard images, the key features are not accurately discovered due to noise and artifacts, leading to erroneous analysis. Existing denoising models mostly build on generalizing the weak signals as noises while the strong signals are enhanced as key features, which is not always the case in microscopy images, thus can completely erase a significant amount of hidden physical information. To address these limitations, we propose a global denoising model (GDM) to smartly remove artifacts of microscopy images while preserving weaker but physically important features. The proposed model is developed based on 1) first designing a two-imaging input channel of non-pair and goal specific pre-processed images with user-defined trade-off information between two channels and 2) then integrating a loss function of pixel- and fast Fourier-transformed (FFT) based on training the U-net model. We compared the proposed GDM with the non-FFT denoising model over STM-generated images of Copper(Cu) and Silicon(Si) materials, AFM-generated Pantoea sp.YR343 bio-film images and SEM-generated plastic degradation images. We believe this proposed workflow can be extended to improve other microscopy image quality and will benefit the experimentalists with the proposed design flexibility to smartly tune via domain-experts preferences.
Related papers
- Generative Image Restoration and Super-Resolution using Physics-Informed Synthetic Data for Scanning Tunneling Microscopy [2.873869397844946]
We propose a machine learning (ML) approach for image repair and super-resolution to alleviate both challenges.<n>We show that a physics-informed synthetic data generation pipeline can be used to train several state-of-the-art flow-matching and diffusion models.<n>Our framework has the potential to significantly increase STM experimental throughput.
arXiv Detail & Related papers (2025-10-29T19:50:34Z) - QWD-GAN: Quality-aware Wavelet-driven GAN for Unsupervised Medical Microscopy Images Denoising [2.99938892718088]
We propose an unsupervised image denoising method based on a Generative Adversarial Network (GAN) architecture.<n>The proposed model achieves state-of-the-art denoising performance, particularly excelling in the preservation of high-frequency information.
arXiv Detail & Related papers (2025-09-19T09:41:48Z) - Deep Generative Learning of Magnetic Frustration in Artificial Spin Ice from Magnetic Force Microscopy Images [0.0]
In this work, we automate the calculation of net magnetic moments and directional orientations of spin-ice configurations.<n>In the first stage, machine learning models are trained to accurately predict magnetic moments and directions within spin-ice structures.<n>The second stage of proposed methodology enables precise identification and prediction of frustrated vertices and nanomagnetic segments.
arXiv Detail & Related papers (2025-07-23T17:40:39Z) - Learning Multi-scale Spatial-frequency Features for Image Denoising [58.883244886588336]
We propose a novel multi-scale adaptive dual-domain network (MADNet) for image denoising.<n>We use image pyramid inputs to restore noise-free results from low-resolution images.<n>In order to realize the interaction of high-frequency and low-frequency information, we design an adaptive spatial-frequency learning unit.
arXiv Detail & Related papers (2025-06-19T13:28:09Z) - Total Variation-Based Image Decomposition and Denoising for Microscopy Images [6.178358125917281]
Experimentally acquired microscopy images are unavoidably affected by the presence of noise and other unwanted signals.<n>This study focuses on image decomposition and denoising of microscopy images through a workflow based on total variation (TV)<n>Our approach consists in restoring an image by extracting its unwanted signal components and subtracting them from the raw one, or by denoising it.
arXiv Detail & Related papers (2025-05-13T14:14:00Z) - DiffDoctor: Diagnosing Image Diffusion Models Before Treating [57.82359018425674]
We propose DiffDoctor, a two-stage pipeline to assist image diffusion models in generating fewer artifacts.<n>We collect a dataset of over 1M flawed synthesized images and set up an efficient human-in-the-loop annotation process.<n>The learned artifact detector is then involved in the second stage to optimize the diffusion model by providing pixel-level feedback.
arXiv Detail & Related papers (2025-01-21T18:56:41Z) - FM2S: Towards Spatially-Correlated Noise Modeling in Zero-Shot Fluorescence Microscopy Image Denoising [33.383511185170214]
Fluorescence Micrograph to Self (FM2S) is a zero-shot denoiser that achieves efficient Fluorescence Micrograph to Self (FM2S) denoising through three key innovations.<n>Experiments across FMI datasets demonstrate FM2S's superiority: It outperforms CVF-SID by 1.4dB PSNR on average while requiring 0.1% parameters of AP-BSN.
arXiv Detail & Related papers (2024-12-13T10:45:25Z) - MaskTerial: A Foundation Model for Automated 2D Material Flake Detection [48.73213960205105]
We present a deep learning model, called MaskTerial, that uses an instance segmentation network to reliably identify 2D material flakes.<n>The model is extensively pre-trained using a synthetic data generator, that generates realistic microscopy images from unlabeled data.<n>We demonstrate significant improvements over existing techniques in the detection of low-contrast materials such as hexagonal boron nitride.
arXiv Detail & Related papers (2024-12-12T15:01:39Z) - Motion Artifact Removal in Pixel-Frequency Domain via Alternate Masks and Diffusion Model [58.694932010573346]
Motion artifacts present in magnetic resonance imaging (MRI) can seriously interfere with clinical diagnosis.<n>We propose a novel unsupervised purification method which leverages pixel-frequency information of noisy MRI images to guide a pre-trained diffusion model to recover clean MRI images.
arXiv Detail & Related papers (2024-12-10T15:25:18Z) - MDiff-FMT: Morphology-aware Diffusion Model for Fluorescence Molecular Tomography with Small-scale Datasets [29.920562899648985]
Fluorescence molecular tomography (FMT) is a sensitive optical imaging technology widely used in biomedical research.<n>The inverse problem poses a huge challenge to FMT reconstruction.<n>We report for the first time a morphology-aware diffusion model, MDiff-FMT, based on denoising diffusion probabilistic model (DDPM) to achieve high-fidelity morphological reconstruction.
arXiv Detail & Related papers (2024-10-09T10:41:31Z) - A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.<n>Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Negligible effect of brain MRI data preprocessing for tumor segmentation [36.89606202543839]
We conduct experiments on three publicly available datasets and evaluate the effect of different preprocessing steps in deep neural networks.
Our results demonstrate that most popular standardization steps add no value to the network performance.
We suggest that image intensity normalization approaches do not contribute to model accuracy because of the reduction of signal variance with image standardization.
arXiv Detail & Related papers (2022-04-11T17:29:36Z) - Blind microscopy image denoising with a deep residual and multiscale
encoder/decoder network [0.0]
Deep multiscale convolutional encoder-decoder neural network is proposed.
The proposed model reaches on average 38.38 of PSNR and 0.98 of SSIM on a test set of 57458 images.
arXiv Detail & Related papers (2021-05-01T14:54:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.